-- Logs begin at Fri 2022-06-17 07:57:08 UTC, end at Fri 2022-06-17 09:11:38 UTC. -- Jun 17 08:42:53.851614 dv-cinder-797608-33-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 17 08:42:53.860748 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 17 08:42:53.862369 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 17 08:42:53 2022] *** Jun 17 08:42:53.862369 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 17 08:42:53.862369 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 17 08:42:53.862369 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: nodename: dv-cinder-797608-33-iscsi Jun 17 08:42:53.862369 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: machine: x86_64 Jun 17 08:42:53.862369 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: clock source: unix Jun 17 08:42:53.862369 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: pcre jit disabled Jun 17 08:42:53.862369 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: detected number of CPU cores: 4 Jun 17 08:42:53.862369 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: current working directory: / Jun 17 08:42:53.862369 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: detected binary path: /usr/bin/uwsgi-core Jun 17 08:42:53.862369 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: your processes number limit is 47680 Jun 17 08:42:53.862369 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: your memory page size is 4096 bytes Jun 17 08:42:53.863209 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: detected max file descriptor number: 2048 Jun 17 08:42:53.863209 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: lock engine: pthread robust mutexes Jun 17 08:42:53.863209 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: thunder lock: enabled Jun 17 08:42:53.863209 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 17 08:42:53.863209 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 17 08:42:53.906959 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: Python main interpreter initialized at 0x55fde80559c0 Jun 17 08:42:53.906959 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: python threads support enabled Jun 17 08:42:53.906959 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: your server socket listen backlog is limited to 100 connections Jun 17 08:42:53.906959 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: your mercy for graceful operations on workers is 90 seconds Jun 17 08:42:53.907367 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: mapped 403077 bytes (393 KB) for 2 cores Jun 17 08:42:53.907441 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: *** Operational MODE: preforking *** Jun 17 08:42:53.907685 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: *** uWSGI is running in multiple interpreter mode *** Jun 17 08:42:53.907685 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: spawned uWSGI master process (pid: 115469) Jun 17 08:42:53.907922 dv-cinder-797608-33-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 17 08:42:53.908503 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: spawned uWSGI worker 1 (pid: 115470, cores: 1) Jun 17 08:42:53.909434 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: spawned uWSGI worker 2 (pid: 115471, cores: 1) Jun 17 08:42:53.909434 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 17 08:42:54.569808 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 08:42:54.571475 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 08:42:55.754742 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 08:42:55.754742 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: from cryptography.utils import int_from_bytes Jun 17 08:42:55.755366 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 08:42:55.755366 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: from cryptography.utils import int_from_bytes Jun 17 08:42:55.757918 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 08:42:55.757918 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: from cryptography.utils import int_from_bytes Jun 17 08:42:55.758340 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 08:42:55.758340 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: from cryptography.utils import int_from_bytes Jun 17 08:42:58.364594 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 08:42:58.365167 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 08:42:58.365258 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 08:42:58.365258 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 08:42:58.365637 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 08:42:58.365716 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 08:42:58.365799 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 08:42:58.365935 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 08:42:58.366071 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 08:42:58.366295 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 08:42:58.366396 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.366626 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.366725 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.366944 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.367044 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.367262 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.367393 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.367612 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.367717 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.367916 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.368026 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.368224 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.368323 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.368540 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.368654 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.368855 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.368948 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.369109 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.369215 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.369419 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.369517 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.369735 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-33-iscsi {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.370372 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.370591 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.370694 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-33-iscsi {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.370897 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.371006 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.371209 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.371304 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.371566 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.371660 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.371867 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.371957 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.372183 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.372277 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.372485 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.372570 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.372811 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.372970 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.373305 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.373451 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.373611 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.373722 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.373913 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.374024 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.374218 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.374502 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.374588 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.374712 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.374846 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.374929 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.375151 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.375245 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.375506 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.375644 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.375815 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.375901 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.376117 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.376210 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.376422 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.376512 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-33-iscsi {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.376806 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.376889 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-33-iscsi {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.377114 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.377242 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.377434 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.377571 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.377733 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.377843 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.378133 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.378237 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.378426 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.378513 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.378731 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.378837 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.379049 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.379142 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.379374 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.379476 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.379689 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.379784 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.380003 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.380089 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.380316 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.380407 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.380628 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.380721 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.380925 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.381024 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.381229 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.381312 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.381527 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.381619 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.381826 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.381909 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.382124 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.382207 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.382424 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.382517 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.382670 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.382754 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.382951 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.383043 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.383256 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.383342 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.383602 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.383687 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.383918 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.384004 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.384169 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.384267 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.384416 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.384502 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.384697 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.384790 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.385010 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.385095 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.385322 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.385405 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.386173 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.386288 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.386480 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.386572 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.386782 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.386873 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.387087 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.387185 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.387405 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.387495 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.387709 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.387796 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.388011 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.388100 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.388313 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.388404 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.388620 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.388720 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.388926 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.389019 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.389230 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.389320 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.389531 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.389614 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.389842 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.389927 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.390154 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.390237 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.390458 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.390549 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.390757 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.390848 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.391094 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.391180 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.391418 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.391517 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.391722 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.391806 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.392033 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.392119 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.392335 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.392443 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.392640 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.392733 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.392943 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.393035 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.393248 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.393344 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.393562 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.393678 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.393887 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.394055 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.394158 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.394252 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.394382 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.394468 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.394682 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.394766 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.394980 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.395070 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.395283 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.395410 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.395608 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.395705 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.395908 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.396001 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.396201 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.396285 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.396493 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.396577 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.396792 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.396876 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.397090 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.397181 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.397389 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.397473 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.397689 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.397772 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.398048 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.398151 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.398277 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.398369 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.398573 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.398657 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.398871 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.399001 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.399168 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.399265 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.399503 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.399593 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.399805 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.399897 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.400105 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.400270 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.400401 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.400486 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.400688 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.400784 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.400992 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.401105 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.401333 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.401426 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.401633 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.401725 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.401933 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.402025 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.402250 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.402344 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.402547 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.402630 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.402845 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.402937 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.403145 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.403228 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.403469 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.403557 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.403781 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.403883 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.404076 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.404171 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.404378 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.404464 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.404686 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.404785 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.404991 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.405083 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.405290 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.405376 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.405589 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.405673 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.405905 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.406045 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.406216 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.406345 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.406493 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.406623 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.406752 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.406881 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.407029 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.407171 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.407309 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.407480 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.407622 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.407758 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.407930 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.408097 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.408253 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.408381 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.408524 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.408652 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.408798 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.408931 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.409107 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.409235 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.409437 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.409564 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:42:58.409764 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.409914 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.410089 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.410231 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.410402 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.410529 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.410727 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.410864 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.411057 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.411184 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.411391 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.411526 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.411701 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.411833 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.412009 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.412149 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.412322 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.412450 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.412626 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.412753 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.412934 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.413073 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.413238 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.413366 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.413545 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.413674 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.413857 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.413984 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.414169 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.414323 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.414462 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.414590 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.414778 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.414919 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.415090 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.415218 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.415419 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.415562 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.415727 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.415875 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.416043 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.416172 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.416358 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.416487 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.416664 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.417288 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.417507 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.417673 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.417924 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.418054 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.418252 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.418398 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.418585 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.418757 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.418888 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.419034 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.419193 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.419304 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.419519 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.419729 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.419859 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.419988 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.420126 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.420264 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.420452 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.420594 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.420761 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.420900 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.421077 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.421214 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.421391 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.421601 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.421743 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.421874 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.422010 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.422139 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.422281 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.422420 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.422582 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.422721 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.422892 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.423021 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.423209 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.423337 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.423549 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.423677 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.423860 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.423947 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.424175 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.424268 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.424483 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.424575 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.424792 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.424884 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.425099 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.425184 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.425401 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.425486 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.425698 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.425781 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.426000 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.426085 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.426298 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.426383 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.426598 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.426694 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.426898 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.426983 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.427220 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.427393 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.427547 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.427694 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.427859 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.427986 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.428166 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.428310 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.428547 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.428712 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.428843 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.428975 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.429106 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.429257 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.429395 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.429533 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.429663 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.429799 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.429929 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.430058 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.430233 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.430372 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.430533 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.430662 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.430846 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.430980 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.431151 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.431282 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.431479 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.431613 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.431790 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.431918 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.432092 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.432230 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.433060 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.433259 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.433394 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.433524 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.433626 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.433755 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.433885 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.434012 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.434142 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.434278 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.434451 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.434581 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.434775 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.434905 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.435088 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.435226 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.435421 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.435552 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.435754 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.435883 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.436084 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.436235 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.436390 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.436520 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.436713 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.436849 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.437036 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.437175 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.437338 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.437468 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.437639 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.437766 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.437940 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.438068 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.438271 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.438405 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.438556 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.438764 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.438917 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.439046 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.439174 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.439302 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.439472 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.439596 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.439738 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.439869 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.439997 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.440124 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.440286 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.440415 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.440587 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.440718 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.440890 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.441027 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.441193 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.441331 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.441747 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.441886 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.442047 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.442176 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.442383 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.442521 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.442686 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.442826 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.443012 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.443099 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.443770 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.443921 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.444057 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.444192 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.444333 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.444468 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.444602 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.444744 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.444880 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.445025 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.445160 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.445294 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.445437 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.445573 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.445707 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.445841 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.445976 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.446110 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.446252 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.446400 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.446535 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.446670 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.446823 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.446967 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.447110 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.447245 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.447408 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.447550 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.447685 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.447818 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.447972 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.448200 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.448353 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.448498 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.448641 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.448818 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.449035 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.449739 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.449881 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.450015 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.450165 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.450304 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.450437 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.450576 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.450714 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.450853 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.451068 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.451216 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.451374 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.451462 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.451540 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.451618 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.451710 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.451789 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.451916 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.452003 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.452081 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.452158 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.452243 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.452329 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.452474 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.452598 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.452792 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.452908 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.453102 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.453227 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.453422 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.453535 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.453730 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.453849 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.454046 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.454138 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.454349 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.454441 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.454662 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.454759 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.454986 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.455079 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.455316 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.455440 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.455648 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.455743 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.455971 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.456076 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.456278 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.456368 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.456581 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.456666 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.456887 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.456970 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.457187 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.457270 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.457490 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.457576 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.457790 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.457881 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.458097 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.458183 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.458405 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.458494 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.458711 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.458794 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.459025 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.459158 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.459310 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.459432 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.459653 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.459749 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.459945 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.460046 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.460247 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.460331 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.460552 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.460637 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.460861 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.460954 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.461167 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.461253 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.461478 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.461570 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.461791 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.461884 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.462092 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.462177 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.462392 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.462476 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.462690 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.462783 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.463001 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.463094 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.463303 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.463442 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.463657 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.463789 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.463956 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.464087 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.464259 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.464432 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.464597 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.464742 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.464905 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.465047 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.465209 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.465363 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.465524 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.465682 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.465894 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.465987 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.466214 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.466306 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.466528 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.466622 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.466838 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.466936 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.467146 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.467238 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.467487 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.467577 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.467794 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.467878 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.468098 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.468194 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.468403 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.468488 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.468707 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.468798 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.469011 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.469104 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.469343 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.469440 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.469621 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.469713 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.469925 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.470021 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.470228 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.470325 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.470529 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.470628 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.470828 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.470922 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.471140 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.471225 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.471524 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.471749 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.472088 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.472174 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.472408 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.472493 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.472719 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.472802 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.473037 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.473123 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.473352 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.473436 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.473670 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.473755 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.473996 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.474088 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.474343 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.474453 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.474648 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.474752 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.474953 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.475160 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.475269 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.475596 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.475733 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.475903 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.476042 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.476217 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.476355 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.476519 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.476663 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.476823 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.476973 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.477128 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.477280 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.477437 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.477591 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.477739 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.477894 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.478042 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.478201 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.478344 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.478502 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.478646 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.478807 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.478960 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.479121 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.480035 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.480165 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.480242 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.480320 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.480506 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.480672 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.480827 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.480918 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.481137 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.481224 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.481437 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.481525 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.481737 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.481821 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.482040 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.482124 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.482375 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.482462 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.482676 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.482760 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.483009 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.483108 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.483333 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.483468 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.483693 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.483791 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.483996 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.484091 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.484299 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.484390 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.484619 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.484705 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.484920 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.485013 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.485223 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.485309 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.485522 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.485605 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.485827 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.485913 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.486131 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.486215 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.486429 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.486512 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.486735 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.486828 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.487037 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.487121 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.487342 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.487522 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.487675 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.487769 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.487974 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.488058 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.488277 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.488361 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.488575 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.488660 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.488885 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.488970 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.489188 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.489283 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.489486 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.489577 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.489784 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.489876 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.490159 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.490268 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.490407 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.490496 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.490678 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.490764 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.490981 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.491080 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.491280 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.491415 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.491615 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.491700 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.491918 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.492026 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.492219 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.492311 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.492517 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.492633 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.492823 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.492909 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.493128 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.493213 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.493425 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.493508 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.493739 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.493824 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.494046 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.494137 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.494343 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.494427 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.494642 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.494728 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.495695 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.495929 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.495929 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.496298 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.496403 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.496584 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.496685 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.496876 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.497009 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.497209 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.497411 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.497502 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.497686 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.497797 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.498080 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.498235 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.498417 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.498604 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.498705 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.498893 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.498985 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.499379 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.499502 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.499600 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.499682 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.499760 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.499845 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.499933 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.500019 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.500162 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.500428 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.500560 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.500653 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.500733 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.500811 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.500887 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.501109 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.501196 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.501407 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.501503 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.501708 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.501792 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.502009 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.502095 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.502343 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.502430 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.502654 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.502749 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.502994 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.503081 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.503293 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.503412 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.503738 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.503845 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.503926 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.504009 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.504232 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.504320 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.504539 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.504623 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.504848 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.504942 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.505148 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.505232 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.505458 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.505552 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.505764 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.505880 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.506072 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.506159 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.506372 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.506465 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.506670 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.506764 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.506982 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.507074 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.507288 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.507394 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.507619 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.507715 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.507936 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.508020 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.508254 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.508339 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.508571 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.508656 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.508872 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.509007 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.509174 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.509314 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.509481 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.509632 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.509771 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.509911 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.510076 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.510210 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.510373 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.510561 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.510693 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.510823 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.510992 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.511126 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.511299 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.511494 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.511639 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.511780 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.511934 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.512072 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.512240 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.512376 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.512549 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.512683 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.512857 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.512995 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.513160 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.513289 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.513479 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.513610 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.513800 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.513946 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.514078 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.514165 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.514386 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.514515 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.514689 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.514782 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.514995 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.515079 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.515293 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.515399 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.515749 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.515836 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.516059 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.516152 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.516372 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.516465 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.516674 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.516760 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.516983 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.517067 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.517292 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.517375 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.517603 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.517688 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.517912 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.517995 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.518213 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.518304 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.518621 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.518706 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.518930 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.519015 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.519237 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.519330 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.519571 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.519656 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.519871 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.519954 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.520172 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.520268 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.520476 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.520608 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.520794 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.520878 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.521092 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.521184 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.521392 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.521477 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.521690 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.521773 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.522007 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.522100 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.522308 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.522392 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.522623 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.522707 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.523032 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.523117 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.523341 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.523453 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.523668 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.523754 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.524080 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.524167 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.524389 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.524473 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.524696 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.524781 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.525011 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.525097 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.525329 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.525412 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.525647 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.525738 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.525948 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.526146 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.526282 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.526376 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.526595 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.526694 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.526913 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.527000 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.527233 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.527328 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.527567 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.527653 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.527879 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.527965 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.528182 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.528319 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.528502 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.528634 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.528823 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.528961 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.529132 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.529262 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.529449 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.529576 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.529857 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.530000 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.530175 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.530314 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.530482 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.530635 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.530799 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.530937 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.531119 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.531254 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.531445 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.531578 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.531729 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.531861 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.532030 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.532163 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.532331 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.532463 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.532633 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.532767 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.532979 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.533110 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.533243 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.533380 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.533546 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.533691 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.533852 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.533985 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.534158 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.534287 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.534457 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.534590 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.534756 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.534894 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.535070 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.535211 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.535391 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.535529 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.535714 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.535854 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.536026 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.536168 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.536342 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.536470 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.536660 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.536787 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.536962 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.537103 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.537277 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.537405 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.537583 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.537723 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.537886 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.538022 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.538186 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.538314 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.538487 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.538614 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.538825 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.538955 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.539126 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.539267 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.539468 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.539597 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.539796 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.539930 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.540121 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.540256 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.540428 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.540557 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.540759 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.540845 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.541084 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.541161 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.541399 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.541474 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.542225 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.542311 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.542552 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.542627 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.542855 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.543026 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.543158 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.543334 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.543492 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.543667 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.543795 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.543957 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.544096 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.544261 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.544395 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.544564 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.544703 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.544872 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.545003 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.545214 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.545310 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.545691 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.545789 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.545878 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.545958 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.546076 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.546182 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.546375 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.546501 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.546694 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.546807 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.547005 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.547106 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.547328 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.547486 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.547652 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.547740 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.547956 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.548049 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.548296 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.548390 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.548599 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.548684 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.548930 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.549023 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.549245 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.549338 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.549565 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.549650 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.549871 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.549955 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.550189 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.550275 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.550501 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.550585 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.550815 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.550938 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.551125 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.551219 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.551458 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.551547 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.551772 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.551866 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.552082 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.552168 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.552393 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.552486 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.552696 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.552781 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.553007 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.553092 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.553315 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.553399 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.553623 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.553709 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.553938 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.554165 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.554477 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.554563 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.554793 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.554887 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.555106 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.555191 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.555456 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.555556 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.555749 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.555848 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.556059 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.556145 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.556367 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.556452 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.556673 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.556774 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.556980 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.557067 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.557288 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.557397 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.558227 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.558321 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.558721 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.558805 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.559052 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.559145 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.559404 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.559495 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.559720 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.559813 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.560038 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.560137 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.560353 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.560440 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.560669 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.560764 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.560976 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.561071 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.561322 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.561407 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.561626 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.561712 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.561931 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.562024 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.562247 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.562346 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.562559 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.562645 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.562868 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.562954 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.563179 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.563265 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.563515 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.563616 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.563826 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.563914 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.564137 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.564223 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.564445 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.564540 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.564753 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.564838 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.565062 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.565146 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.565372 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.565474 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.565699 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.565796 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.566013 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.566098 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.566324 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.566685 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.566903 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.566990 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.567215 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.567300 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.567555 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.567758 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.568072 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.568157 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.568389 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.568483 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.568712 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.568797 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.569032 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.569118 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.569344 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.569429 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.569657 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.569744 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.569978 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.570068 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.570281 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.570369 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.570584 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.570678 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.570891 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.570985 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.571199 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.571297 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.571529 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.571618 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.571835 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.571921 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.572145 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.572239 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.572454 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.572541 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.572758 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.572843 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.573089 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.573195 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.573508 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.573619 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.573965 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.574050 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.574280 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.574444 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.574604 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.574698 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.574925 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.575014 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.575241 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.575335 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.575574 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.575665 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.575900 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.575999 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.576204 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.576292 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.576508 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.576592 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.576815 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.576901 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.577122 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.577208 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.577426 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.577518 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.577729 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.577813 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.578034 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.578122 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.578340 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.578425 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.578643 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.578738 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.578946 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.579031 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.579246 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.579330 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.579586 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.579686 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.579888 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.579972 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.580190 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.580277 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.580492 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.580585 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.580794 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.580887 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.581100 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.581265 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.581398 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.581499 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.581700 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.581787 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.582001 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.582105 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.582313 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.582400 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.582612 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.582698 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.582918 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.583003 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.583218 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.583306 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.583550 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.583682 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.583851 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.583948 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.584151 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.584238 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.584460 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.584553 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.584799 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.584885 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.585100 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.585187 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.585401 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.585494 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.585700 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.585792 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.586006 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.586103 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.586309 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.586395 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.586614 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.586707 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.586921 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.587007 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.587225 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.587316 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.587588 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.587691 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.587903 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.588118 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.588453 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.588551 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.588804 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.588901 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.589124 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.589343 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.589447 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.589674 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.589771 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.589980 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.590067 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.590283 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.590369 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.590588 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.590684 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.590913 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.591000 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.591224 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.591316 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.591560 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.591659 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.591870 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.591955 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.592176 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.592261 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.592481 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.592580 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.592786 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.592879 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.593094 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.593180 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.593399 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.593485 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.593704 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.593796 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.594034 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.594134 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.594311 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.594397 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.594616 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.594701 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.594917 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.595002 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.595227 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.595313 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.595588 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.595676 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.595903 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.596056 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.596217 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.596348 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.596530 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.596628 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.596840 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.596951 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.597146 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.597240 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.597452 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.597547 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.597754 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.597860 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.598057 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.598150 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.598366 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.598474 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.598689 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.598788 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.598998 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.599093 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.599297 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.599436 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.599740 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.599837 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.600048 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.600140 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.600365 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.600457 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.600685 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.600779 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.600989 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.601081 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.601308 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.601417 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.601624 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.601710 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.601930 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.602013 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.602246 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.602339 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.602553 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.602645 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.602876 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.602960 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.603209 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.603394 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.603556 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.603643 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.603881 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.603980 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.604181 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.604913 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.604997 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.605064 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.605287 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.605442 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.605593 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.605760 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.605909 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.606162 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.606256 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.606403 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.606576 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.606717 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.606853 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.606988 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.607122 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.607255 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.607441 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.607578 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.607689 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.607880 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.607992 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.608181 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.608295 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.608483 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.608603 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.608789 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.608904 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.609091 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.609179 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.609391 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.609477 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.609716 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.609874 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.609971 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.610075 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.610275 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.610362 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.610573 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.610662 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.610880 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.610968 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.611181 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.611268 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.611505 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.611609 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.611807 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.611893 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.612106 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.612193 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.612403 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.612502 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.612728 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.612815 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.613053 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.613146 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.613363 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.613461 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.613670 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.613755 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.613976 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.614060 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.614283 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.614368 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.614585 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.614715 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.614901 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.614996 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.615213 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.615313 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.615540 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.615629 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.615844 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.615929 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.616165 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.616298 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.616474 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.616589 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.616782 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.616880 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.617086 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.617189 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.617391 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.617486 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.617696 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.617800 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.618004 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.618099 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.618318 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.618418 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.618623 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.618726 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.618920 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.619014 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.619240 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.619341 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.619575 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.619678 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.619937 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.620536 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.620746 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.620967 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.621156 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.621281 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.621508 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.621595 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.621823 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.621909 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.622139 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.622233 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.622449 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.622534 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.622763 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.622856 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.623081 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.623168 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.623415 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.623505 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.623730 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.623825 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.624052 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.624156 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.624361 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.624455 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.624665 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.624759 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.624988 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.625073 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.625309 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.625402 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.625630 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.625723 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.625948 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.626033 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.626289 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.626441 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.626708 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.626862 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.626998 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.627133 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.627262 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.627416 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.627564 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 08:42:58.627697 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:42:58.627841 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 08:42:58.690916 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO dbcounter [None req-abf08af8-9d7f-49af-8087-6663d553881d None None] Registered counter for database nova_api Jun 17 08:42:58.692539 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO dbcounter [None req-fa2eb3a3-df40-4b99-819e-1d0b3c6de3f2 None None] Registered counter for database nova_api Jun 17 08:42:58.714481 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG oslo_db.sqlalchemy.engines [None req-abf08af8-9d7f-49af-8087-6663d553881d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:42:58.718230 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG oslo_db.sqlalchemy.engines [None req-fa2eb3a3-df40-4b99-819e-1d0b3c6de3f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:42:58.721570 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG dbcounter [-] [115471] Writer thread running {{(pid=115471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:42:58.726731 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG dbcounter [-] [115470] Writer thread running {{(pid=115470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:42:58.780406 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.context [None req-abf08af8-9d7f-49af-8087-6663d553881d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4ac623a5-dc81-4845-8d0c-a315180756a6(cell1) {{(pid=115471) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 08:42:58.784623 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG oslo_concurrency.lockutils [None req-abf08af8-9d7f-49af-8087-6663d553881d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:58.786159 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.context [None req-fa2eb3a3-df40-4b99-819e-1d0b3c6de3f2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4ac623a5-dc81-4845-8d0c-a315180756a6(cell1) {{(pid=115470) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 08:42:58.786279 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG oslo_concurrency.lockutils [None req-abf08af8-9d7f-49af-8087-6663d553881d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:58.786982 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG oslo_concurrency.lockutils [None req-abf08af8-9d7f-49af-8087-6663d553881d None None] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:58.789035 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG oslo_concurrency.lockutils [None req-abf08af8-9d7f-49af-8087-6663d553881d None None] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:58.790361 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG oslo_concurrency.lockutils [None req-fa2eb3a3-df40-4b99-819e-1d0b3c6de3f2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:58.791180 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO dbcounter [None req-abf08af8-9d7f-49af-8087-6663d553881d None None] Registered counter for database nova_cell0 Jun 17 08:42:58.792808 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG oslo_concurrency.lockutils [None req-fa2eb3a3-df40-4b99-819e-1d0b3c6de3f2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:58.793706 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG oslo_concurrency.lockutils [None req-fa2eb3a3-df40-4b99-819e-1d0b3c6de3f2 None None] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:58.795731 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO dbcounter [None req-abf08af8-9d7f-49af-8087-6663d553881d None None] Registered counter for database nova_cell1 Jun 17 08:42:58.795851 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG oslo_concurrency.lockutils [None req-fa2eb3a3-df40-4b99-819e-1d0b3c6de3f2 None None] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:58.797800 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO dbcounter [None req-fa2eb3a3-df40-4b99-819e-1d0b3c6de3f2 None None] Registered counter for database nova_cell0 Jun 17 08:42:58.801793 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO dbcounter [None req-fa2eb3a3-df40-4b99-819e-1d0b3c6de3f2 None None] Registered counter for database nova_cell1 Jun 17 08:42:58.803130 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG oslo_db.sqlalchemy.engines [None req-abf08af8-9d7f-49af-8087-6663d553881d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:42:58.805332 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG oslo_db.sqlalchemy.engines [None req-abf08af8-9d7f-49af-8087-6663d553881d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:42:58.809250 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG oslo_db.sqlalchemy.engines [None req-fa2eb3a3-df40-4b99-819e-1d0b3c6de3f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:42:58.811083 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG oslo_db.sqlalchemy.engines [None req-fa2eb3a3-df40-4b99-819e-1d0b3c6de3f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:42:58.811253 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG dbcounter [-] [115471] Writer thread running {{(pid=115471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:42:58.812560 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG dbcounter [-] [115471] Writer thread running {{(pid=115471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:42:58.817002 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG dbcounter [-] [115470] Writer thread running {{(pid=115470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:42:58.819457 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG dbcounter [-] [115470] Writer thread running {{(pid=115470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:42:58.960278 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO dbcounter [None req-abf08af8-9d7f-49af-8087-6663d553881d None None] Registered counter for database nova_cell0 Jun 17 08:42:58.966198 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO dbcounter [None req-fa2eb3a3-df40-4b99-819e-1d0b3c6de3f2 None None] Registered counter for database nova_cell0 Jun 17 08:42:58.968936 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG oslo_db.sqlalchemy.engines [None req-abf08af8-9d7f-49af-8087-6663d553881d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:42:58.973881 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG dbcounter [-] [115471] Writer thread running {{(pid=115471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:42:58.975446 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG oslo_db.sqlalchemy.engines [None req-fa2eb3a3-df40-4b99-819e-1d0b3c6de3f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:42:58.979863 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG dbcounter [-] [115470] Writer thread running {{(pid=115470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:42:59.389402 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: WARNING keystonemiddleware.auth_token [None req-abf08af8-9d7f-49af-8087-6663d553881d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 08:42:59.396744 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: WARNING keystonemiddleware.auth_token [None req-abf08af8-9d7f-49af-8087-6663d553881d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 08:42:59.413607 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: WARNING keystonemiddleware.auth_token [None req-fa2eb3a3-df40-4b99-819e-1d0b3c6de3f2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 08:42:59.421565 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: WARNING keystonemiddleware.auth_token [None req-fa2eb3a3-df40-4b99-819e-1d0b3c6de3f2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 08:42:59.740592 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: WARNING keystonemiddleware.auth_token [None req-abf08af8-9d7f-49af-8087-6663d553881d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 08:42:59.747222 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: WARNING keystonemiddleware.auth_token [None req-abf08af8-9d7f-49af-8087-6663d553881d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 08:42:59.752428 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fde80559c0 pid: 115471 (default app) Jun 17 08:42:59.754463 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-abf08af8-9d7f-49af-8087-6663d553881d None None] Calling method '>' {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:59.755677 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-abf08af8-9d7f-49af-8087-6663d553881d None None] 10.222.0.78 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001714 Jun 17 08:42:59.756093 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 1/1] 10.222.0.78 () {50 vars in 788 bytes} [Fri Jun 17 08:42:59 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:42:59.772084 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: WARNING keystonemiddleware.auth_token [None req-fa2eb3a3-df40-4b99-819e-1d0b3c6de3f2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 08:42:59.778160 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: WARNING keystonemiddleware.auth_token [None req-fa2eb3a3-df40-4b99-819e-1d0b3c6de3f2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 08:42:59.783589 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fde80559c0 pid: 115470 (default app) Jun 17 08:44:20.321368 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-abf08af8-9d7f-49af-8087-6663d553881d None None] Calling method '>' {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:20.322300 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-abf08af8-9d7f-49af-8087-6663d553881d None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jun 17 08:44:20.322710 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 2/2] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jun 17 08:44:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:44:20.339953 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG dbcounter [-] [115470] Writing DB stats nova_api:SELECT=3 {{(pid=115470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:44:20.340906 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG dbcounter [-] [115470] Writing DB stats nova_cell0:SELECT=3 {{(pid=115470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:44:20.341615 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG dbcounter [-] [115470] Writing DB stats nova_cell1:SELECT=3 {{(pid=115470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:44:20.342503 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG dbcounter [-] [115470] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:44:20.777096 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-28df3204-75c5-46a3-843b-3c554d62f528 admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:20.807014 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-28df3204-75c5-46a3-843b-3c554d62f528 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.476358 Jun 17 08:44:20.807964 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 1/3] 10.222.0.78 () {60 vars in 1291 bytes} [Fri Jun 17 08:44:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:44:23.007015 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-abf08af8-9d7f-49af-8087-6663d553881d None None] Calling method '>' {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:23.009150 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-abf08af8-9d7f-49af-8087-6663d553881d None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002471 Jun 17 08:44:23.009787 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 3/4] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jun 17 08:44:23 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:44:23.074713 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-59716138-e98f-4703-94c8-75b60e82e6be admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 256, "id": "c1", "name": "cirros256"}} {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:44:23.093095 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:44:23.093095 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: warnings.warn(msg) Jun 17 08:44:23.184510 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-59716138-e98f-4703-94c8-75b60e82e6be admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.167690 Jun 17 08:44:23.185290 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 2/5] 10.222.0.78 () {64 vars in 1282 bytes} [Fri Jun 17 08:44:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:44:23.199487 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG dbcounter [-] [115471] Writing DB stats nova_api:SELECT=3 {{(pid=115471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:44:23.200754 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG dbcounter [-] [115471] Writing DB stats nova_cell0:SELECT=3 {{(pid=115471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:44:23.201578 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG dbcounter [-] [115471] Writing DB stats nova_cell1:SELECT=3 {{(pid=115471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:44:23.202494 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG dbcounter [-] [115471] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:44:23.406076 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-481b76c4-f228-405a-9711-7a8d17c6f83e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:44:23.408390 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:44:23.408390 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: warnings.warn(msg) Jun 17 08:44:23.546674 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-481b76c4-f228-405a-9711-7a8d17c6f83e admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.353078 Jun 17 08:44:23.555498 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 4/6] 10.222.0.78 () {64 vars in 1335 bytes} [Fri Jun 17 08:44:23 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:44:25.745231 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-59716138-e98f-4703-94c8-75b60e82e6be admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:25.746338 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-59716138-e98f-4703-94c8-75b60e82e6be admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 17 08:44:25.746738 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 3/7] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jun 17 08:44:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:44:25.860612 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-03870067-6b00-418e-90a5-14575e90cd58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "id": "d1", "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "disk": 5, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:44:25.884081 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:44:25.884081 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: warnings.warn(msg) Jun 17 08:44:26.002716 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-03870067-6b00-418e-90a5-14575e90cd58 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.249794 Jun 17 08:44:26.003279 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 5/8] 10.222.0.78 () {64 vars in 1282 bytes} [Fri Jun 17 08:44:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:44:26.015847 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-70ad3ede-4b11-47b6-89b1-2fc3aa805aec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:44:26.017359 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:44:26.017359 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: warnings.warn(msg) Jun 17 08:44:26.165469 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-70ad3ede-4b11-47b6-89b1-2fc3aa805aec admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.153338 Jun 17 08:44:26.166050 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 4/9] 10.222.0.78 () {64 vars in 1335 bytes} [Fri Jun 17 08:44:26 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:44:28.374728 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-03870067-6b00-418e-90a5-14575e90cd58 admin admin] Calling method '>' {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:28.375784 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-03870067-6b00-418e-90a5-14575e90cd58 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jun 17 08:44:28.376177 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 6/10] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jun 17 08:44:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:44:28.442751 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-dce62d82-33b5-42a2-a3b7-ebaa9c8c5bdb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "id": "d2", "vcpus": 1, "ram": 1024, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:44:28.562904 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-dce62d82-33b5-42a2-a3b7-ebaa9c8c5bdb admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.180834 Jun 17 08:44:28.563853 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 5/11] 10.222.0.78 () {64 vars in 1282 bytes} [Fri Jun 17 08:44:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:44:28.576244 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-c9e7f3f9-3a28-4a7a-bac2-ad793e78dfcb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:44:28.651857 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-c9e7f3f9-3a28-4a7a-bac2-ad793e78dfcb admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079222 Jun 17 08:44:28.652838 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 7/12] 10.222.0.78 () {64 vars in 1335 bytes} [Fri Jun 17 08:44:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:44:30.887218 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-dce62d82-33b5-42a2-a3b7-ebaa9c8c5bdb admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:30.888373 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-dce62d82-33b5-42a2-a3b7-ebaa9c8c5bdb admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jun 17 08:44:30.888869 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 6/13] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jun 17 08:44:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:44:30.958296 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-1e53710c-d486-49fa-994a-cb43eb2c47d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:44:31.310965 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-1e53710c-d486-49fa-994a-cb43eb2c47d5 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.415369 Jun 17 08:44:31.311584 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 8/14] 10.222.0.78 () {64 vars in 1282 bytes} [Fri Jun 17 08:44:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:44:31.324028 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-0980d19f-eb57-42af-b80a-fb9ea27e45f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:44:31.421888 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-0980d19f-eb57-42af-b80a-fb9ea27e45f8 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101426 Jun 17 08:44:31.422475 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 7/15] 10.222.0.78 () {64 vars in 1335 bytes} [Fri Jun 17 08:44:31 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:44:33.676843 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-1e53710c-d486-49fa-994a-cb43eb2c47d5 admin admin] Calling method '>' {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:33.677855 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-1e53710c-d486-49fa-994a-cb43eb2c47d5 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jun 17 08:44:33.678522 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 9/16] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jun 17 08:44:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:44:33.741783 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-4e5917cf-e441-400d-b950-599b81efe285 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "name": "ds4G", "ram": 4096}} {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:44:33.819120 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-4e5917cf-e441-400d-b950-599b81efe285 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.134089 Jun 17 08:44:33.819841 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 8/17] 10.222.0.78 () {64 vars in 1282 bytes} [Fri Jun 17 08:44:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 08:44:33.832817 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-8eff4426-a5df-49d3-8b20-cf58a4c12dc7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:44:33.944205 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-8eff4426-a5df-49d3-8b20-cf58a4c12dc7 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115177 Jun 17 08:44:33.955875 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 10/18] 10.222.0.78 () {64 vars in 1335 bytes} [Fri Jun 17 08:44:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:44:36.136871 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-4e5917cf-e441-400d-b950-599b81efe285 admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:36.137883 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-4e5917cf-e441-400d-b950-599b81efe285 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jun 17 08:44:36.138436 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 9/19] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jun 17 08:44:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:44:36.199889 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-b77f1bcc-28a6-4847-8557-ea69ca5eb17f admin admin] Calling method '>' {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:36.224281 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-b77f1bcc-28a6-4847-8557-ea69ca5eb17f admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079962 Jun 17 08:44:36.233229 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 11/20] 10.222.0.78 () {60 vars in 1291 bytes} [Fri Jun 17 08:44:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:44:38.469143 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-4e5917cf-e441-400d-b950-599b81efe285 admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:38.470252 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-4e5917cf-e441-400d-b950-599b81efe285 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001584 Jun 17 08:44:38.470707 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 10/21] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jun 17 08:44:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:44:38.544464 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-47742bc1-dddb-4194-abfc-9e20a346adea admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "name": "m1.tiny", "ram": 512, "id": "1"}} {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:44:38.744636 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-47742bc1-dddb-4194-abfc-9e20a346adea admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.267328 Jun 17 08:44:38.745199 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 12/22] 10.222.0.78 () {64 vars in 1282 bytes} [Fri Jun 17 08:44:38 2022] POST /compute/v2.1/flavors => generated 402 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 08:44:38.756806 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-1eb549f3-1ca3-4dfc-bc92-9cefcc25d6a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:44:38.858283 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-1eb549f3-1ca3-4dfc-bc92-9cefcc25d6a9 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105031 Jun 17 08:44:38.858926 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 11/23] 10.222.0.78 () {64 vars in 1332 bytes} [Fri Jun 17 08:44:38 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:44:41.121304 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-47742bc1-dddb-4194-abfc-9e20a346adea admin admin] Calling method '>' {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:41.122327 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-47742bc1-dddb-4194-abfc-9e20a346adea admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jun 17 08:44:41.122734 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 13/24] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jun 17 08:44:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:44:41.194631 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-7b1798b3-541f-45de-b383-ea4e3254db20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.small", "vcpus": 1, "ram": 2048, "disk": 20, "id": "2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:44:41.270925 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-7b1798b3-541f-45de-b383-ea4e3254db20 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.141105 Jun 17 08:44:41.271976 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 12/25] 10.222.0.78 () {64 vars in 1282 bytes} [Fri Jun 17 08:44:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:44:41.287682 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-c4be9d90-49e5-4ba6-882b-08920e593132 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:44:41.380888 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-c4be9d90-49e5-4ba6-882b-08920e593132 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097717 Jun 17 08:44:41.381391 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 14/26] 10.222.0.78 () {64 vars in 1332 bytes} [Fri Jun 17 08:44:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:44:43.862016 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-7b1798b3-541f-45de-b383-ea4e3254db20 admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:43.863068 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-7b1798b3-541f-45de-b383-ea4e3254db20 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 17 08:44:43.863542 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 13/27] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jun 17 08:44:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:44:43.924031 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-d73a7460-773b-4fae-842d-921a840e51e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "3", "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 40, "swap": 0}} {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:44:44.059167 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-d73a7460-773b-4fae-842d-921a840e51e5 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.189451 Jun 17 08:44:44.059767 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 15/28] 10.222.0.78 () {64 vars in 1282 bytes} [Fri Jun 17 08:44:43 2022] POST /compute/v2.1/flavors => generated 406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:44:44.072816 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-2fc13f83-9c67-4f69-8e0f-eafaf989f66a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:44:44.166061 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-2fc13f83-9c67-4f69-8e0f-eafaf989f66a admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097780 Jun 17 08:44:44.166648 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 14/29] 10.222.0.78 () {64 vars in 1332 bytes} [Fri Jun 17 08:44:44 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:44:46.379767 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-d73a7460-773b-4fae-842d-921a840e51e5 admin admin] Calling method '>' {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:46.380863 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-d73a7460-773b-4fae-842d-921a840e51e5 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001675 Jun 17 08:44:46.381260 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 16/30] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jun 17 08:44:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:44:46.439266 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-33551623-ef65-4830-a0e3-ab99b0d66d45 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 8192, "disk": 80, "os-flavor-access:is_public": true, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:44:46.933455 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-33551623-ef65-4830-a0e3-ab99b0d66d45 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.545003 Jun 17 08:44:46.933923 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 15/31] 10.222.0.78 () {64 vars in 1282 bytes} [Fri Jun 17 08:44:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:44:46.946163 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-1e9392ae-3bcd-42b4-b9a1-2ab990e77044 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:44:47.061674 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-1e9392ae-3bcd-42b4-b9a1-2ab990e77044 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119143 Jun 17 08:44:47.062273 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 17/32] 10.222.0.78 () {64 vars in 1332 bytes} [Fri Jun 17 08:44:46 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:44:49.281903 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-33551623-ef65-4830-a0e3-ab99b0d66d45 admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:49.298509 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-33551623-ef65-4830-a0e3-ab99b0d66d45 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001679 Jun 17 08:44:49.298509 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 16/33] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jun 17 08:44:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:44:49.352978 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-38d31ff8-b33e-4ef8-9bfc-09b63ba81725 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "disk": 160, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 16384, "swap": 0, "vcpus": 8, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:44:49.807471 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-38d31ff8-b33e-4ef8-9bfc-09b63ba81725 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.516780 Jun 17 08:44:49.808125 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 18/34] 10.222.0.78 () {64 vars in 1282 bytes} [Fri Jun 17 08:44:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 08:44:49.820687 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-3d42b353-0e46-4779-a605-82947874273c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:44:49.918988 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-3d42b353-0e46-4779-a605-82947874273c admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102404 Jun 17 08:44:49.920461 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 17/35] 10.222.0.78 () {64 vars in 1332 bytes} [Fri Jun 17 08:44:49 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:45:14.185269 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-38d31ff8-b33e-4ef8-9bfc-09b63ba81725 admin admin] Calling method '>' {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:14.186289 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-38d31ff8-b33e-4ef8-9bfc-09b63ba81725 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003567 Jun 17 08:45:14.186691 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 19/36] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jun 17 08:45:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:45:14.198417 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG dbcounter [-] [115470] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=115470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:45:14.250028 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-0b20a477-3dd6-4a23-8523-f477f92a4b7c admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:14.268386 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-0b20a477-3dd6-4a23-8523-f477f92a4b7c admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.074815 Jun 17 08:45:14.268933 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 18/37] 10.222.0.78 () {60 vars in 1291 bytes} [Fri Jun 17 08:45:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:45:15.266269 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-38d31ff8-b33e-4ef8-9bfc-09b63ba81725 admin admin] Calling method '>' {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:15.267267 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-38d31ff8-b33e-4ef8-9bfc-09b63ba81725 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 17 08:45:15.267690 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 20/38] 10.222.0.78 () {56 vars in 1074 bytes} [Fri Jun 17 08:45:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:45:15.476650 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-08f1e446-f89a-4b73-95e2-a565575e3c00 admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:15.482223 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.wsgi [None req-08f1e446-f89a-4b73-95e2-a565575e3c00 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 17 08:45:15.485524 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-08f1e446-f89a-4b73-95e2-a565575e3c00 admin admin] Request method failure captured: Jun 17 08:45:15.485524 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 17 08:45:15.485524 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: Accept: application/json Jun 17 08:45:15.485524 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: Accept-Encoding: gzip, deflate Jun 17 08:45:15.485524 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: Connection: keep-alive Jun 17 08:45:15.485524 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: Content-Length: 0 Jun 17 08:45:15.485524 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: Host: 10.222.0.78 Jun 17 08:45:15.485524 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: Openstack-Api-Version: compute 2.90 Jun 17 08:45:15.485524 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: Openstack-System-Scope: None Jun 17 08:45:15.485524 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: User-Agent: python-novaclient Jun 17 08:45:15.485524 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Auth-Token: gAAAAABirD8brh4oFy2DB7L4AIp6iJazMVU-Lo4AWHxJix0VLzuQJhvKSs8rXk4MsNNcxT-iqF7Kr8Ro8JOJ5sm84Hyt4qfV09FgnXQcQzw8T3SZZlNz7nTSDHzhu2WGdif2TsZ4pjp73Sa6viwRFaMjVb4969GX9aOQoamD_zFg0LFWuJxA71c Jun 17 08:45:15.485524 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Domain-Id: None Jun 17 08:45:15.485524 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Domain-Name: None Jun 17 08:45:15.485524 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Identity-Status: Confirmed Jun 17 08:45:15.485524 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Is-Admin-Project: True Jun 17 08:45:15.485524 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 08:45:15.485524 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Project-Domain-Id: default Jun 17 08:45:15.485524 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Project-Domain-Name: Default Jun 17 08:45:15.485524 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Project-Id: 9bb6ac161b2c421f94fa26d18ee99634 Jun 17 08:45:15.485524 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Project-Name: admin Jun 17 08:45:15.485524 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Role: admin,member,reader Jun 17 08:45:15.485524 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Roles: admin,member,reader Jun 17 08:45:15.486990 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9bb6ac161b2c421f94fa26d18ee99634"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9bb6ac161b2c421f94fa26d18ee99634"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9bb6ac161b2c421f94fa26d18ee99634"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9bb6ac161b2c421f94fa26d18ee99634"}]}] Jun 17 08:45:15.486990 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Tenant: admin Jun 17 08:45:15.486990 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Tenant-Id: 9bb6ac161b2c421f94fa26d18ee99634 Jun 17 08:45:15.486990 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Tenant-Name: admin Jun 17 08:45:15.486990 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-User: admin Jun 17 08:45:15.486990 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-User-Domain-Id: default Jun 17 08:45:15.486990 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-User-Domain-Name: Default Jun 17 08:45:15.486990 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-User-Id: 1449ff4f407540dd843ab2db406229f6 Jun 17 08:45:15.486990 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-User-Name: admin Jun 17 08:45:15.486990 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: method: > Jun 17 08:45:15.486990 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: exception: Flavor 42 could not be found. Jun 17 08:45:15.486990 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: action_args: {'id': '42'} Jun 17 08:45:15.486990 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:45:15.486990 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:45:15.487829 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 08:45:15.487829 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 08:45:15.487829 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 08:45:15.487829 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 08:45:15.487829 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 08:45:15.487829 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 08:45:15.487829 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 08:45:15.487829 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 08:45:15.487829 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 08:45:15.487829 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:45:15.487829 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 08:45:15.487829 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 08:45:15.487829 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 17 08:45:15.487829 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi Jun 17 08:45:15.487829 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:45:15.487829 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi Jun 17 08:45:15.487829 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:45:15.487829 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:45:15.487829 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:45:15.488992 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:45:15.488992 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:45:15.488992 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:45:15.488992 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:45:15.488992 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 08:45:15.488992 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:45:15.488992 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 17 08:45:15.488992 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi Jun 17 08:45:15.488992 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:45:15.488992 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi Jun 17 08:45:15.488992 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:45:15.488992 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:45:15.488992 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:45:15.488992 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:45:15.488992 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:45:15.488992 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 17 08:45:15.488992 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi Jun 17 08:45:15.488992 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-08f1e446-f89a-4b73-95e2-a565575e3c00 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:45:15.490064 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-08f1e446-f89a-4b73-95e2-a565575e3c00 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.064412 Jun 17 08:45:15.490064 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 19/39] 10.222.0.78 () {60 vars in 1190 bytes} [Fri Jun 17 08:45:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:15.497280 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-4353a8fa-f957-4588-8d11-5d109fb99c51 admin admin] Calling method '>' {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:15.500423 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG dbcounter [-] [115471] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=115471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:45:15.520419 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-4353a8fa-f957-4588-8d11-5d109fb99c51 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026757 Jun 17 08:45:15.520986 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 21/40] 10.222.0.78 () {60 vars in 1210 bytes} [Fri Jun 17 08:45:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:45:15.531008 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-aedd003f-8765-4d74-8403-5a34a95bc626 admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:15.552893 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-aedd003f-8765-4d74-8403-5a34a95bc626 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025487 Jun 17 08:45:15.553444 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 20/41] 10.222.0.78 () {60 vars in 1210 bytes} [Fri Jun 17 08:45:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:45:15.563519 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-a1c10baa-27d1-4f8a-8fa1-10da739f61c3 admin admin] Calling method '>' {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:15.569690 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.wsgi [None req-a1c10baa-27d1-4f8a-8fa1-10da739f61c3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 17 08:45:15.573665 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-a1c10baa-27d1-4f8a-8fa1-10da739f61c3 admin admin] Request method failure captured: Jun 17 08:45:15.573665 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 17 08:45:15.573665 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: Accept: application/json Jun 17 08:45:15.573665 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: Accept-Encoding: gzip, deflate Jun 17 08:45:15.573665 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: Connection: keep-alive Jun 17 08:45:15.573665 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: Content-Length: 0 Jun 17 08:45:15.573665 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: Host: 10.222.0.78 Jun 17 08:45:15.573665 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: Openstack-Api-Version: compute 2.90 Jun 17 08:45:15.573665 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: Openstack-System-Scope: None Jun 17 08:45:15.573665 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: User-Agent: python-novaclient Jun 17 08:45:15.573665 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Auth-Token: gAAAAABirD8brh4oFy2DB7L4AIp6iJazMVU-Lo4AWHxJix0VLzuQJhvKSs8rXk4MsNNcxT-iqF7Kr8Ro8JOJ5sm84Hyt4qfV09FgnXQcQzw8T3SZZlNz7nTSDHzhu2WGdif2TsZ4pjp73Sa6viwRFaMjVb4969GX9aOQoamD_zFg0LFWuJxA71c Jun 17 08:45:15.573665 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Domain-Id: None Jun 17 08:45:15.573665 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Domain-Name: None Jun 17 08:45:15.573665 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Identity-Status: Confirmed Jun 17 08:45:15.573665 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Is-Admin-Project: True Jun 17 08:45:15.573665 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 08:45:15.573665 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Project-Domain-Id: default Jun 17 08:45:15.573665 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Project-Domain-Name: Default Jun 17 08:45:15.573665 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Project-Id: 9bb6ac161b2c421f94fa26d18ee99634 Jun 17 08:45:15.573665 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Project-Name: admin Jun 17 08:45:15.573665 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Role: admin,member,reader Jun 17 08:45:15.573665 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Roles: admin,member,reader Jun 17 08:45:15.575235 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9bb6ac161b2c421f94fa26d18ee99634"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9bb6ac161b2c421f94fa26d18ee99634"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9bb6ac161b2c421f94fa26d18ee99634"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9bb6ac161b2c421f94fa26d18ee99634"}]}] Jun 17 08:45:15.575235 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Tenant: admin Jun 17 08:45:15.575235 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Tenant-Id: 9bb6ac161b2c421f94fa26d18ee99634 Jun 17 08:45:15.575235 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Tenant-Name: admin Jun 17 08:45:15.575235 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-User: admin Jun 17 08:45:15.575235 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-User-Domain-Id: default Jun 17 08:45:15.575235 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-User-Domain-Name: Default Jun 17 08:45:15.575235 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-User-Id: 1449ff4f407540dd843ab2db406229f6 Jun 17 08:45:15.575235 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-User-Name: admin Jun 17 08:45:15.575235 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: method: > Jun 17 08:45:15.575235 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: exception: Flavor 42 could not be found. Jun 17 08:45:15.575235 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: action_args: {'id': '42'} Jun 17 08:45:15.575235 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:45:15.575235 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:45:15.576243 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 08:45:15.576243 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 08:45:15.576243 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 08:45:15.576243 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 08:45:15.576243 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 08:45:15.576243 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 08:45:15.576243 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 08:45:15.576243 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 08:45:15.576243 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 08:45:15.576243 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:45:15.576243 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 08:45:15.576243 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 08:45:15.576243 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 17 08:45:15.576243 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi Jun 17 08:45:15.576243 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:45:15.576243 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi Jun 17 08:45:15.576243 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:45:15.576243 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:45:15.576243 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:45:15.577268 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:45:15.577268 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:45:15.577268 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:45:15.577268 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:45:15.577268 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 08:45:15.577268 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:45:15.577268 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 17 08:45:15.577268 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi Jun 17 08:45:15.577268 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:45:15.577268 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi Jun 17 08:45:15.577268 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:45:15.577268 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:45:15.577268 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:45:15.577268 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:45:15.577268 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:45:15.577268 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 17 08:45:15.577268 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi Jun 17 08:45:15.577268 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-a1c10baa-27d1-4f8a-8fa1-10da739f61c3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:45:15.578293 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-a1c10baa-27d1-4f8a-8fa1-10da739f61c3 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015100 Jun 17 08:45:15.578293 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 22/42] 10.222.0.78 () {60 vars in 1190 bytes} [Fri Jun 17 08:45:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:16.453395 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-aedd003f-8765-4d74-8403-5a34a95bc626 admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:16.454404 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-aedd003f-8765-4d74-8403-5a34a95bc626 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 17 08:45:16.455090 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 21/43] 10.222.0.78 () {56 vars in 1074 bytes} [Fri Jun 17 08:45:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:45:16.650019 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-5203276b-7bc9-4b93-b184-bd1ba37807c8 admin admin] Calling method '>' {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:16.655462 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.wsgi [None req-5203276b-7bc9-4b93-b184-bd1ba37807c8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 17 08:45:16.656996 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-5203276b-7bc9-4b93-b184-bd1ba37807c8 admin admin] Request method failure captured: Jun 17 08:45:16.656996 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 17 08:45:16.656996 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: Accept: application/json Jun 17 08:45:16.656996 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: Accept-Encoding: gzip, deflate Jun 17 08:45:16.656996 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: Connection: keep-alive Jun 17 08:45:16.656996 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: Content-Length: 0 Jun 17 08:45:16.656996 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: Host: 10.222.0.78 Jun 17 08:45:16.656996 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: Openstack-Api-Version: compute 2.90 Jun 17 08:45:16.656996 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: Openstack-System-Scope: None Jun 17 08:45:16.656996 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: User-Agent: python-novaclient Jun 17 08:45:16.656996 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Auth-Token: gAAAAABirD8cs3Q2n0q62QnFN6Xhclm93qfl-LN1opvNp59IvYwvusRlAH3ruCiM78NBJmFvjBk0eM7CCXB8tNgfigqWnBrTZ4cNnl66ai6b3NbqO4cKYpa3COTc99tzky6A3Rvxh9xrKMEib7T7FQ-mrZl8htNGwDH6uNb7WtezC4rpsfKE4Xs Jun 17 08:45:16.656996 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Domain-Id: None Jun 17 08:45:16.656996 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Domain-Name: None Jun 17 08:45:16.656996 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Identity-Status: Confirmed Jun 17 08:45:16.656996 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Is-Admin-Project: True Jun 17 08:45:16.656996 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 08:45:16.656996 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Project-Domain-Id: default Jun 17 08:45:16.656996 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Project-Domain-Name: Default Jun 17 08:45:16.656996 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Project-Id: 9bb6ac161b2c421f94fa26d18ee99634 Jun 17 08:45:16.656996 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Project-Name: admin Jun 17 08:45:16.656996 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Role: admin,member,reader Jun 17 08:45:16.656996 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Roles: admin,member,reader Jun 17 08:45:16.658494 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9bb6ac161b2c421f94fa26d18ee99634"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9bb6ac161b2c421f94fa26d18ee99634"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9bb6ac161b2c421f94fa26d18ee99634"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9bb6ac161b2c421f94fa26d18ee99634"}]}] Jun 17 08:45:16.658494 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Tenant: admin Jun 17 08:45:16.658494 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Tenant-Id: 9bb6ac161b2c421f94fa26d18ee99634 Jun 17 08:45:16.658494 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Tenant-Name: admin Jun 17 08:45:16.658494 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-User: admin Jun 17 08:45:16.658494 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-User-Domain-Id: default Jun 17 08:45:16.658494 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-User-Domain-Name: Default Jun 17 08:45:16.658494 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-User-Id: 1449ff4f407540dd843ab2db406229f6 Jun 17 08:45:16.658494 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-User-Name: admin Jun 17 08:45:16.658494 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: method: > Jun 17 08:45:16.658494 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: exception: Flavor 84 could not be found. Jun 17 08:45:16.658494 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: action_args: {'id': '84'} Jun 17 08:45:16.658494 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:45:16.658494 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:45:16.659291 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 08:45:16.659291 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 08:45:16.659291 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 08:45:16.659291 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 08:45:16.659291 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 08:45:16.659291 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 08:45:16.659291 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 08:45:16.659291 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 08:45:16.659291 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 08:45:16.659291 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:45:16.659291 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 08:45:16.659291 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 08:45:16.659291 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 17 08:45:16.659291 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi Jun 17 08:45:16.659291 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:45:16.659291 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi Jun 17 08:45:16.659291 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:45:16.659291 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:45:16.659291 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:45:16.660514 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:45:16.660514 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:45:16.660514 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:45:16.660514 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:45:16.660514 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 08:45:16.660514 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:45:16.660514 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 17 08:45:16.660514 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi Jun 17 08:45:16.660514 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:45:16.660514 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi Jun 17 08:45:16.660514 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:45:16.660514 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:45:16.660514 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:45:16.660514 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:45:16.660514 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:45:16.660514 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 17 08:45:16.660514 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi Jun 17 08:45:16.660514 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-5203276b-7bc9-4b93-b184-bd1ba37807c8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:45:16.661611 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-5203276b-7bc9-4b93-b184-bd1ba37807c8 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062370 Jun 17 08:45:16.661611 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 23/44] 10.222.0.78 () {60 vars in 1190 bytes} [Fri Jun 17 08:45:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:16.668885 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-7e486d2a-bb87-4300-a349-27b1a7b93a7a admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:16.685180 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-7e486d2a-bb87-4300-a349-27b1a7b93a7a admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019915 Jun 17 08:45:16.685734 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 22/45] 10.222.0.78 () {60 vars in 1210 bytes} [Fri Jun 17 08:45:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:45:16.695963 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-6fa44d64-5764-4177-9fe0-efd6873fc414 admin admin] Calling method '>' {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:16.709699 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-6fa44d64-5764-4177-9fe0-efd6873fc414 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017600 Jun 17 08:45:16.710241 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 24/46] 10.222.0.78 () {60 vars in 1210 bytes} [Fri Jun 17 08:45:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:45:16.720124 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-062e9a05-5822-4b45-a850-ff4d10e600b0 admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:16.725506 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.wsgi [None req-062e9a05-5822-4b45-a850-ff4d10e600b0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 17 08:45:16.727630 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-062e9a05-5822-4b45-a850-ff4d10e600b0 admin admin] Request method failure captured: Jun 17 08:45:16.727630 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 17 08:45:16.727630 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: Accept: application/json Jun 17 08:45:16.727630 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: Accept-Encoding: gzip, deflate Jun 17 08:45:16.727630 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: Connection: keep-alive Jun 17 08:45:16.727630 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: Content-Length: 0 Jun 17 08:45:16.727630 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: Host: 10.222.0.78 Jun 17 08:45:16.727630 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: Openstack-Api-Version: compute 2.90 Jun 17 08:45:16.727630 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: Openstack-System-Scope: None Jun 17 08:45:16.727630 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: User-Agent: python-novaclient Jun 17 08:45:16.727630 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Auth-Token: gAAAAABirD8cs3Q2n0q62QnFN6Xhclm93qfl-LN1opvNp59IvYwvusRlAH3ruCiM78NBJmFvjBk0eM7CCXB8tNgfigqWnBrTZ4cNnl66ai6b3NbqO4cKYpa3COTc99tzky6A3Rvxh9xrKMEib7T7FQ-mrZl8htNGwDH6uNb7WtezC4rpsfKE4Xs Jun 17 08:45:16.727630 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Domain-Id: None Jun 17 08:45:16.727630 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Domain-Name: None Jun 17 08:45:16.727630 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Identity-Status: Confirmed Jun 17 08:45:16.727630 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Is-Admin-Project: True Jun 17 08:45:16.727630 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 08:45:16.727630 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Project-Domain-Id: default Jun 17 08:45:16.727630 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Project-Domain-Name: Default Jun 17 08:45:16.727630 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Project-Id: 9bb6ac161b2c421f94fa26d18ee99634 Jun 17 08:45:16.727630 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Project-Name: admin Jun 17 08:45:16.727630 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Role: admin,member,reader Jun 17 08:45:16.727630 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Roles: admin,member,reader Jun 17 08:45:16.729089 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9bb6ac161b2c421f94fa26d18ee99634"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9bb6ac161b2c421f94fa26d18ee99634"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9bb6ac161b2c421f94fa26d18ee99634"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9bb6ac161b2c421f94fa26d18ee99634"}]}] Jun 17 08:45:16.729089 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Tenant: admin Jun 17 08:45:16.729089 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Tenant-Id: 9bb6ac161b2c421f94fa26d18ee99634 Jun 17 08:45:16.729089 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Tenant-Name: admin Jun 17 08:45:16.729089 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-User: admin Jun 17 08:45:16.729089 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-User-Domain-Id: default Jun 17 08:45:16.729089 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-User-Domain-Name: Default Jun 17 08:45:16.729089 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-User-Id: 1449ff4f407540dd843ab2db406229f6 Jun 17 08:45:16.729089 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-User-Name: admin Jun 17 08:45:16.729089 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: method: > Jun 17 08:45:16.729089 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: exception: Flavor 84 could not be found. Jun 17 08:45:16.729089 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: action_args: {'id': '84'} Jun 17 08:45:16.729089 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:45:16.729089 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:45:16.729908 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 08:45:16.729908 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 08:45:16.729908 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 08:45:16.729908 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 08:45:16.729908 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 08:45:16.729908 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 08:45:16.729908 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 08:45:16.729908 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 08:45:16.729908 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 08:45:16.729908 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:45:16.729908 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 08:45:16.729908 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 08:45:16.729908 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 17 08:45:16.729908 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi Jun 17 08:45:16.729908 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:45:16.729908 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi Jun 17 08:45:16.729908 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:45:16.729908 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:45:16.729908 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:45:16.731002 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:45:16.731002 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:45:16.731002 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:45:16.731002 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:45:16.731002 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 08:45:16.731002 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:45:16.731002 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 17 08:45:16.731002 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi Jun 17 08:45:16.731002 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:45:16.731002 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi Jun 17 08:45:16.731002 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:45:16.731002 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:45:16.731002 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:45:16.731002 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:45:16.731002 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:45:16.731002 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 17 08:45:16.731002 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi Jun 17 08:45:16.731002 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-062e9a05-5822-4b45-a850-ff4d10e600b0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:45:16.732061 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-062e9a05-5822-4b45-a850-ff4d10e600b0 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012440 Jun 17 08:45:16.732061 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 23/47] 10.222.0.78 () {60 vars in 1190 bytes} [Fri Jun 17 08:45:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:17.621847 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-6fa44d64-5764-4177-9fe0-efd6873fc414 admin admin] Calling method '>' {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:17.622857 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-6fa44d64-5764-4177-9fe0-efd6873fc414 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jun 17 08:45:17.623244 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 25/48] 10.222.0.78 () {56 vars in 1074 bytes} [Fri Jun 17 08:45:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:45:17.815205 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-1de45b3e-03f0-434f-9e84-53eccf82c60f admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:17.820961 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.wsgi [None req-1de45b3e-03f0-434f-9e84-53eccf82c60f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 17 08:45:17.822442 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-1de45b3e-03f0-434f-9e84-53eccf82c60f admin admin] Request method failure captured: Jun 17 08:45:17.822442 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 17 08:45:17.822442 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: Accept: application/json Jun 17 08:45:17.822442 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: Accept-Encoding: gzip, deflate Jun 17 08:45:17.822442 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: Connection: keep-alive Jun 17 08:45:17.822442 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: Content-Length: 0 Jun 17 08:45:17.822442 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: Host: 10.222.0.78 Jun 17 08:45:17.822442 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: Openstack-Api-Version: compute 2.90 Jun 17 08:45:17.822442 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: Openstack-System-Scope: None Jun 17 08:45:17.822442 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: User-Agent: python-novaclient Jun 17 08:45:17.822442 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Auth-Token: gAAAAABirD8dObF8stWLcQ9HSyNburUTHXAHS9EPvVkxqV5XFr6qKbiFpq0Zi0zh3piftEWM68sdD8V9RQjDpiKEBDXOsl_CctJ9AWUZI4YOgNVo12iJbAT-Tso1nKwakqwUiblTFphhn6mjgdDJhcQiv3XZiPJYFbgE3GMxDTTf-jlm8XXmlBM Jun 17 08:45:17.822442 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Domain-Id: None Jun 17 08:45:17.822442 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Domain-Name: None Jun 17 08:45:17.822442 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Identity-Status: Confirmed Jun 17 08:45:17.822442 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Is-Admin-Project: True Jun 17 08:45:17.822442 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 08:45:17.822442 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Project-Domain-Id: default Jun 17 08:45:17.822442 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Project-Domain-Name: Default Jun 17 08:45:17.822442 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Project-Id: 9bb6ac161b2c421f94fa26d18ee99634 Jun 17 08:45:17.822442 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Project-Name: admin Jun 17 08:45:17.822442 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Role: admin,member,reader Jun 17 08:45:17.822442 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Roles: admin,member,reader Jun 17 08:45:17.823820 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9bb6ac161b2c421f94fa26d18ee99634"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9bb6ac161b2c421f94fa26d18ee99634"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9bb6ac161b2c421f94fa26d18ee99634"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9bb6ac161b2c421f94fa26d18ee99634"}]}] Jun 17 08:45:17.823820 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Tenant: admin Jun 17 08:45:17.823820 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Tenant-Id: 9bb6ac161b2c421f94fa26d18ee99634 Jun 17 08:45:17.823820 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-Tenant-Name: admin Jun 17 08:45:17.823820 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-User: admin Jun 17 08:45:17.823820 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-User-Domain-Id: default Jun 17 08:45:17.823820 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-User-Domain-Name: Default Jun 17 08:45:17.823820 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-User-Id: 1449ff4f407540dd843ab2db406229f6 Jun 17 08:45:17.823820 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: X-User-Name: admin Jun 17 08:45:17.823820 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: method: > Jun 17 08:45:17.823820 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: exception: Flavor 451 could not be found. Jun 17 08:45:17.823820 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: action_args: {'id': '451'} Jun 17 08:45:17.823820 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:45:17.823820 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:45:17.824624 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 08:45:17.824624 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 08:45:17.824624 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 08:45:17.824624 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 08:45:17.824624 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 08:45:17.824624 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 08:45:17.824624 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 08:45:17.824624 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 08:45:17.824624 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 08:45:17.824624 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:45:17.824624 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 08:45:17.824624 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 08:45:17.824624 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 17 08:45:17.824624 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi Jun 17 08:45:17.824624 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:45:17.824624 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi Jun 17 08:45:17.824624 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:45:17.824624 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:45:17.824624 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:45:17.825692 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:45:17.825692 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:45:17.825692 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:45:17.825692 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:45:17.825692 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 08:45:17.825692 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:45:17.825692 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 17 08:45:17.825692 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi Jun 17 08:45:17.825692 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:45:17.825692 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi Jun 17 08:45:17.825692 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:45:17.825692 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:45:17.825692 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:45:17.825692 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:45:17.825692 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:45:17.825692 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 17 08:45:17.825692 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: ERROR nova.api.openstack.wsgi Jun 17 08:45:17.825692 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-1de45b3e-03f0-434f-9e84-53eccf82c60f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:45:17.826801 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-1de45b3e-03f0-434f-9e84-53eccf82c60f admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061346 Jun 17 08:45:17.826801 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 24/49] 10.222.0.78 () {60 vars in 1193 bytes} [Fri Jun 17 08:45:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:17.833374 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-f01ef783-71ac-4359-9d8a-0b25f488734a admin admin] Calling method '>' {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:17.847424 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-f01ef783-71ac-4359-9d8a-0b25f488734a admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017588 Jun 17 08:45:17.847967 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 26/50] 10.222.0.78 () {60 vars in 1210 bytes} [Fri Jun 17 08:45:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:45:17.858086 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-c281e37c-8a33-4ad6-8c6b-b827998e33a2 admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:17.871895 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-c281e37c-8a33-4ad6-8c6b-b827998e33a2 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017397 Jun 17 08:45:17.872424 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 25/51] 10.222.0.78 () {60 vars in 1210 bytes} [Fri Jun 17 08:45:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:45:17.881676 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-136ad330-a1f1-4661-bcca-a16944341c85 admin admin] Calling method '>' {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:17.887530 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.wsgi [None req-136ad330-a1f1-4661-bcca-a16944341c85 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 17 08:45:17.889024 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-136ad330-a1f1-4661-bcca-a16944341c85 admin admin] Request method failure captured: Jun 17 08:45:17.889024 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 17 08:45:17.889024 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: Accept: application/json Jun 17 08:45:17.889024 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: Accept-Encoding: gzip, deflate Jun 17 08:45:17.889024 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: Connection: keep-alive Jun 17 08:45:17.889024 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: Content-Length: 0 Jun 17 08:45:17.889024 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: Host: 10.222.0.78 Jun 17 08:45:17.889024 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: Openstack-Api-Version: compute 2.90 Jun 17 08:45:17.889024 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: Openstack-System-Scope: None Jun 17 08:45:17.889024 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: User-Agent: python-novaclient Jun 17 08:45:17.889024 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Auth-Token: gAAAAABirD8dObF8stWLcQ9HSyNburUTHXAHS9EPvVkxqV5XFr6qKbiFpq0Zi0zh3piftEWM68sdD8V9RQjDpiKEBDXOsl_CctJ9AWUZI4YOgNVo12iJbAT-Tso1nKwakqwUiblTFphhn6mjgdDJhcQiv3XZiPJYFbgE3GMxDTTf-jlm8XXmlBM Jun 17 08:45:17.889024 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Domain-Id: None Jun 17 08:45:17.889024 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Domain-Name: None Jun 17 08:45:17.889024 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Identity-Status: Confirmed Jun 17 08:45:17.889024 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Is-Admin-Project: True Jun 17 08:45:17.889024 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 08:45:17.889024 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Project-Domain-Id: default Jun 17 08:45:17.889024 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Project-Domain-Name: Default Jun 17 08:45:17.889024 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Project-Id: 9bb6ac161b2c421f94fa26d18ee99634 Jun 17 08:45:17.889024 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Project-Name: admin Jun 17 08:45:17.889024 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Role: admin,member,reader Jun 17 08:45:17.889024 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Roles: admin,member,reader Jun 17 08:45:17.890403 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9bb6ac161b2c421f94fa26d18ee99634"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9bb6ac161b2c421f94fa26d18ee99634"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9bb6ac161b2c421f94fa26d18ee99634"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9bb6ac161b2c421f94fa26d18ee99634"}]}] Jun 17 08:45:17.890403 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Tenant: admin Jun 17 08:45:17.890403 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Tenant-Id: 9bb6ac161b2c421f94fa26d18ee99634 Jun 17 08:45:17.890403 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-Tenant-Name: admin Jun 17 08:45:17.890403 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-User: admin Jun 17 08:45:17.890403 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-User-Domain-Id: default Jun 17 08:45:17.890403 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-User-Domain-Name: Default Jun 17 08:45:17.890403 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-User-Id: 1449ff4f407540dd843ab2db406229f6 Jun 17 08:45:17.890403 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: X-User-Name: admin Jun 17 08:45:17.890403 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: method: > Jun 17 08:45:17.890403 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: exception: Flavor 451 could not be found. Jun 17 08:45:17.890403 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: action_args: {'id': '451'} Jun 17 08:45:17.890403 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:45:17.890403 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:45:17.891281 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 08:45:17.891281 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 08:45:17.891281 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 08:45:17.891281 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 08:45:17.891281 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 08:45:17.891281 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 08:45:17.891281 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 08:45:17.891281 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 08:45:17.891281 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 08:45:17.891281 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:45:17.891281 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 08:45:17.891281 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 08:45:17.891281 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 17 08:45:17.891281 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi Jun 17 08:45:17.891281 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:45:17.891281 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi Jun 17 08:45:17.891281 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:45:17.891281 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:45:17.891281 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:45:17.892445 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:45:17.892445 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:45:17.892445 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:45:17.892445 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:45:17.892445 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 08:45:17.892445 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:45:17.892445 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 17 08:45:17.892445 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi Jun 17 08:45:17.892445 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:45:17.892445 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi Jun 17 08:45:17.892445 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:45:17.892445 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:45:17.892445 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:45:17.892445 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:45:17.892445 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:45:17.892445 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 17 08:45:17.892445 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: ERROR nova.api.openstack.wsgi Jun 17 08:45:17.892445 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-136ad330-a1f1-4661-bcca-a16944341c85 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:45:17.893428 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-136ad330-a1f1-4661-bcca-a16944341c85 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012325 Jun 17 08:45:17.893428 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 27/52] 10.222.0.78 () {60 vars in 1193 bytes} [Fri Jun 17 08:45:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:18.754258 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-c281e37c-8a33-4ad6-8c6b-b827998e33a2 admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:18.755256 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-c281e37c-8a33-4ad6-8c6b-b827998e33a2 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jun 17 08:45:18.755694 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 26/53] 10.222.0.78 () {56 vars in 1074 bytes} [Fri Jun 17 08:45:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:45:18.949384 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-af71cc58-b87e-4651-ba12-9edb8916bcdd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:45:19.045576 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-af71cc58-b87e-4651-ba12-9edb8916bcdd admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.149741 Jun 17 08:45:19.046117 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 28/54] 10.222.0.78 () {64 vars in 1235 bytes} [Fri Jun 17 08:45:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:45:19.921713 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-c281e37c-8a33-4ad6-8c6b-b827998e33a2 admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:19.922713 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-c281e37c-8a33-4ad6-8c6b-b827998e33a2 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jun 17 08:45:19.923108 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 27/55] 10.222.0.78 () {56 vars in 1074 bytes} [Fri Jun 17 08:45:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:45:20.114023 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-777abc16-6eb8-4f10-b16c-3848b8551c32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:45:20.194192 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-777abc16-6eb8-4f10-b16c-3848b8551c32 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.132356 Jun 17 08:45:20.194677 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 29/56] 10.222.0.78 () {64 vars in 1235 bytes} [Fri Jun 17 08:45:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:45:21.075202 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-c281e37c-8a33-4ad6-8c6b-b827998e33a2 admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:21.076244 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-c281e37c-8a33-4ad6-8c6b-b827998e33a2 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jun 17 08:45:21.076643 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 28/57] 10.222.0.78 () {56 vars in 1074 bytes} [Fri Jun 17 08:45:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:45:21.270117 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-e7af0933-c0fa-4385-bf06-f4ad6fd516d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:45:21.361211 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-e7af0933-c0fa-4385-bf06-f4ad6fd516d3 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.144904 Jun 17 08:45:21.361757 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 30/58] 10.222.0.78 () {64 vars in 1235 bytes} [Fri Jun 17 08:45:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:45:22.246803 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-c281e37c-8a33-4ad6-8c6b-b827998e33a2 admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:22.247835 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-c281e37c-8a33-4ad6-8c6b-b827998e33a2 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jun 17 08:45:22.248231 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 29/59] 10.222.0.78 () {56 vars in 1074 bytes} [Fri Jun 17 08:45:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:45:22.440710 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-5c6f9e09-66f6-4051-9165-b82a4e44fcb8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:45:22.542780 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-5c6f9e09-66f6-4051-9165-b82a4e44fcb8 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.155034 Jun 17 08:45:22.543331 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 31/60] 10.222.0.78 () {64 vars in 1235 bytes} [Fri Jun 17 08:45:22 2022] POST /compute/v2.1/flavors => generated 409 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:45:23.432826 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-c281e37c-8a33-4ad6-8c6b-b827998e33a2 admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:23.433817 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-c281e37c-8a33-4ad6-8c6b-b827998e33a2 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jun 17 08:45:23.434206 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 30/61] 10.222.0.78 () {56 vars in 1074 bytes} [Fri Jun 17 08:45:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:45:23.627761 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-c9d74296-ebea-4827-9838-039d32a1b3e6 admin admin] Calling method '>' {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:23.647335 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-c9d74296-ebea-4827-9838-039d32a1b3e6 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.074611 Jun 17 08:45:23.647850 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 32/62] 10.222.0.78 () {60 vars in 1202 bytes} [Fri Jun 17 08:45:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:12.628438 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-c281e37c-8a33-4ad6-8c6b-b827998e33a2 admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:12.629452 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-c281e37c-8a33-4ad6-8c6b-b827998e33a2 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 17 08:46:12.629848 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 31/63] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jun 17 08:46:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:46:12.640844 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG dbcounter [-] [115471] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=115471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:46:12.695887 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-27af026e-a900-4f1a-841e-4a6e41a067db admin admin] Calling method '>' {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:12.715336 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-27af026e-a900-4f1a-841e-4a6e41a067db admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.078879 Jun 17 08:46:12.715933 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 33/64] 10.222.0.78 () {60 vars in 1291 bytes} [Fri Jun 17 08:46:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:46:12.740023 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-a783eaf6-3254-49a7-b944-9bbc5f492a36 admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:12.744075 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG dbcounter [-] [115470] Writing DB stats nova_api:SELECT=14 {{(pid=115470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:46:12.749345 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-a783eaf6-3254-49a7-b944-9bbc5f492a36 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012900 Jun 17 08:46:12.749898 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 32/65] 10.222.0.78 () {60 vars in 1282 bytes} [Fri Jun 17 08:46:12 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:46:12.762161 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-c8ec4ce3-23ab-4901-a930-0ff262de57c8 admin admin] Calling method '>' {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:12.770147 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-c8ec4ce3-23ab-4901-a930-0ff262de57c8 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011933 Jun 17 08:46:12.770681 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 34/66] 10.222.0.78 () {60 vars in 1285 bytes} [Fri Jun 17 08:46:12 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:46:12.782470 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-06e5b974-5ab9-4570-9e3c-225175959b3c admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:12.791012 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-06e5b974-5ab9-4570-9e3c-225175959b3c admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012125 Jun 17 08:46:12.791589 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 33/67] 10.222.0.78 () {60 vars in 1285 bytes} [Fri Jun 17 08:46:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:46:12.803741 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-e81085ba-1341-4b4f-9213-ae1e7797a5ba admin admin] Calling method '>' {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:12.811813 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-e81085ba-1341-4b4f-9213-ae1e7797a5ba admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012259 Jun 17 08:46:12.812373 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 35/68] 10.222.0.78 () {60 vars in 1282 bytes} [Fri Jun 17 08:46:12 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:49:41.617071 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-06e5b974-5ab9-4570-9e3c-225175959b3c admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:49:41.618097 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-06e5b974-5ab9-4570-9e3c-225175959b3c admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jun 17 08:49:41.618510 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 34/69] 10.222.0.78 () {56 vars in 1074 bytes} [Fri Jun 17 08:49:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:49:41.775911 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG dbcounter [-] [115471] Writing DB stats nova_api:SELECT=6 {{(pid=115471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:49:41.891077 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-2e4a89c4-f788-47b2-b0fa-c266b240b710 admin admin] Calling method '>' {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:49:41.892300 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:49:41.892300 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: warnings.warn(msg) Jun 17 08:49:41.893672 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG oslo_concurrency.lockutils [None req-2e4a89c4-f788-47b2-b0fa-c266b240b710 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:49:41.894113 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG oslo_concurrency.lockutils [None req-2e4a89c4-f788-47b2-b0fa-c266b240b710 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:49:41.894891 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG oslo_concurrency.lockutils [None req-2e4a89c4-f788-47b2-b0fa-c266b240b710 admin admin] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:49:41.895311 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG oslo_concurrency.lockutils [None req-2e4a89c4-f788-47b2-b0fa-c266b240b710 admin admin] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:49:41.928983 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-2e4a89c4-f788-47b2-b0fa-c266b240b710 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.154428 Jun 17 08:49:41.929546 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 36/70] 10.222.0.78 () {60 vars in 1193 bytes} [Fri Jun 17 08:49:41 2022] GET /compute/v2.1/os-services => generated 794 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:49:42.820058 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-06e5b974-5ab9-4570-9e3c-225175959b3c admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:49:42.821080 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-06e5b974-5ab9-4570-9e3c-225175959b3c admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 17 08:49:42.821480 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 35/71] 10.222.0.78 () {56 vars in 1074 bytes} [Fri Jun 17 08:49:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:49:43.016367 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-afa5b7a0-2641-436e-a5f9-ccf70c7adbc6 admin admin] Calling method '>' {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:49:43.017548 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:49:43.017548 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: warnings.warn(msg) Jun 17 08:49:43.018721 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG oslo_concurrency.lockutils [None req-afa5b7a0-2641-436e-a5f9-ccf70c7adbc6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:49:43.019161 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG oslo_concurrency.lockutils [None req-afa5b7a0-2641-436e-a5f9-ccf70c7adbc6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:49:43.020009 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG oslo_concurrency.lockutils [None req-afa5b7a0-2641-436e-a5f9-ccf70c7adbc6 admin admin] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:49:43.020433 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG oslo_concurrency.lockutils [None req-afa5b7a0-2641-436e-a5f9-ccf70c7adbc6 admin admin] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:49:43.039725 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-afa5b7a0-2641-436e-a5f9-ccf70c7adbc6 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.077275 Jun 17 08:49:43.040212 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 37/72] 10.222.0.78 () {60 vars in 1193 bytes} [Fri Jun 17 08:49:42 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:49:54.548790 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-06e5b974-5ab9-4570-9e3c-225175959b3c admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:49:54.549793 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-06e5b974-5ab9-4570-9e3c-225175959b3c admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 17 08:49:54.550183 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 36/73] 10.222.0.78 () {56 vars in 1074 bytes} [Fri Jun 17 08:49:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:49:54.700049 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG dbcounter [-] [115471] Writing DB stats nova_cell0:SELECT=4 {{(pid=115471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:49:54.701106 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG dbcounter [-] [115471] Writing DB stats nova_cell1:SELECT=4 {{(pid=115471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:49:54.702062 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG dbcounter [-] [115471] Writing DB stats nova_api:SELECT=8 {{(pid=115471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:49:54.760446 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-1aac06e7-ada7-482c-9843-01fa1eeec8cd admin admin] Calling method '>' {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:49:54.761650 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:49:54.761650 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: warnings.warn(msg) Jun 17 08:49:54.763029 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG oslo_concurrency.lockutils [None req-1aac06e7-ada7-482c-9843-01fa1eeec8cd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:49:54.763544 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG oslo_concurrency.lockutils [None req-1aac06e7-ada7-482c-9843-01fa1eeec8cd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:49:54.767241 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG oslo_concurrency.lockutils [None req-1aac06e7-ada7-482c-9843-01fa1eeec8cd admin admin] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:49:54.767241 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG oslo_concurrency.lockutils [None req-1aac06e7-ada7-482c-9843-01fa1eeec8cd admin admin] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:49:54.793305 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-1aac06e7-ada7-482c-9843-01fa1eeec8cd admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.100557 Jun 17 08:49:54.797120 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 38/74] 10.222.0.78 () {60 vars in 1193 bytes} [Fri Jun 17 08:49:54 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:49:55.791173 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: DEBUG nova.api.openstack.wsgi [None req-06e5b974-5ab9-4570-9e3c-225175959b3c admin admin] Calling method '>' {{(pid=115470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:49:55.792197 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: INFO nova.api.openstack.requestlog [None req-06e5b974-5ab9-4570-9e3c-225175959b3c admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jun 17 08:49:55.792595 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: [pid: 115470|app: 0|req: 37/75] 10.222.0.78 () {56 vars in 1074 bytes} [Fri Jun 17 08:49:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:49:55.987904 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG nova.api.openstack.wsgi [None req-a690514c-27d5-49c8-9378-57f9cd17e9be admin admin] Calling method '>' {{(pid=115471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:49:55.989139 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:49:55.989139 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: warnings.warn(msg) Jun 17 08:49:55.990836 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG oslo_concurrency.lockutils [None req-a690514c-27d5-49c8-9378-57f9cd17e9be admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:49:55.991267 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG oslo_concurrency.lockutils [None req-a690514c-27d5-49c8-9378-57f9cd17e9be admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:49:55.992057 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG oslo_concurrency.lockutils [None req-a690514c-27d5-49c8-9378-57f9cd17e9be admin admin] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:49:55.992475 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: DEBUG oslo_concurrency.lockutils [None req-a690514c-27d5-49c8-9378-57f9cd17e9be admin admin] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:49:56.013846 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: INFO nova.api.openstack.requestlog [None req-a690514c-27d5-49c8-9378-57f9cd17e9be admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.079890 Jun 17 08:49:56.014327 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: [pid: 115471|app: 0|req: 39/76] 10.222.0.78 () {60 vars in 1193 bytes} [Fri Jun 17 08:49:55 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:52.705781 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: Fri Jun 17 08:50:52 2022 - graceful shutdown triggered... Jun 17 08:50:52.706304 dv-cinder-797608-33-iscsi devstack@n-api.service[115471]: Gracefully killing worker 2 (pid: 115471)... Jun 17 08:50:52.705934 dv-cinder-797608-33-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 17 08:50:52.711044 dv-cinder-797608-33-iscsi devstack@n-api.service[115470]: Gracefully killing worker 1 (pid: 115470)... Jun 17 08:50:53.706929 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: worker 1 buried after 1 seconds Jun 17 08:50:53.706929 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: worker 2 buried after 1 seconds Jun 17 08:50:53.706929 dv-cinder-797608-33-iscsi devstack@n-api.service[115469]: goodbye to uWSGI. Jun 17 08:50:53.708586 dv-cinder-797608-33-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 17 08:50:53.709395 dv-cinder-797608-33-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 17 08:50:53.713351 dv-cinder-797608-33-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 17 08:50:53.729853 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 17 08:50:53.733437 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 17 08:50:53 2022] *** Jun 17 08:50:53.733437 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 17 08:50:53.733437 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 17 08:50:53.733437 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: nodename: dv-cinder-797608-33-iscsi Jun 17 08:50:53.733437 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: machine: x86_64 Jun 17 08:50:53.733437 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: clock source: unix Jun 17 08:50:53.733437 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: pcre jit disabled Jun 17 08:50:53.733437 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: detected number of CPU cores: 4 Jun 17 08:50:53.733437 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: current working directory: / Jun 17 08:50:53.733437 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: detected binary path: /usr/bin/uwsgi-core Jun 17 08:50:53.733437 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: your processes number limit is 47680 Jun 17 08:50:53.733437 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: your memory page size is 4096 bytes Jun 17 08:50:53.733437 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: detected max file descriptor number: 2048 Jun 17 08:50:53.734931 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: lock engine: pthread robust mutexes Jun 17 08:50:53.734931 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: thunder lock: enabled Jun 17 08:50:53.734931 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 17 08:50:53.734931 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 17 08:50:53.784977 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: Python main interpreter initialized at 0x55e163b999c0 Jun 17 08:50:53.784977 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: python threads support enabled Jun 17 08:50:53.784977 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: your server socket listen backlog is limited to 100 connections Jun 17 08:50:53.784977 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: your mercy for graceful operations on workers is 90 seconds Jun 17 08:50:53.785494 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: mapped 403077 bytes (393 KB) for 2 cores Jun 17 08:50:53.785847 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: *** Operational MODE: preforking *** Jun 17 08:50:53.786480 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: *** uWSGI is running in multiple interpreter mode *** Jun 17 08:50:53.786659 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: spawned uWSGI master process (pid: 129859) Jun 17 08:50:53.787075 dv-cinder-797608-33-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 17 08:50:53.791937 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: spawned uWSGI worker 1 (pid: 129875, cores: 1) Jun 17 08:50:53.792391 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: spawned uWSGI worker 2 (pid: 129876, cores: 1) Jun 17 08:50:53.792726 dv-cinder-797608-33-iscsi devstack@n-api.service[129859]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 17 08:50:54.491284 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 08:50:55.010029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 08:50:55.904906 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 08:50:55.904906 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: from cryptography.utils import int_from_bytes Jun 17 08:50:55.906135 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 08:50:55.906135 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: from cryptography.utils import int_from_bytes Jun 17 08:50:56.359893 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 08:50:56.359893 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: from cryptography.utils import int_from_bytes Jun 17 08:50:56.360768 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 08:50:56.360768 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: from cryptography.utils import int_from_bytes Jun 17 08:50:58.620418 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 08:50:58.621038 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 08:50:58.621238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 08:50:58.621616 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 08:50:58.621880 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 08:50:58.622278 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.622606 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.622934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.623262 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.623632 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.623945 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.624274 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.624775 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.625012 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.625281 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.625612 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.625943 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-33-iscsi {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.626277 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.626590 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.626909 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.627238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.627579 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.627909 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.628222 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.628733 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.629213 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.629498 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.629820 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.630443 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.630612 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.630816 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.631152 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.631987 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.632324 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.632646 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.633051 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-33-iscsi {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.633376 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.633700 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.634017 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.634442 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.634760 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.635073 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.635433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.635766 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.636091 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.636437 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.636765 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.637092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.637566 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.638097 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.638330 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.638551 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.638842 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.639156 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.639494 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.639751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.640067 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.640399 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.640729 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.641061 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.641304 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.641563 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.641889 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.643757 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.643757 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.643757 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.643757 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.643757 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.643757 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.644891 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.644891 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.644891 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.645386 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.645386 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.645702 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.645872 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.646175 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.646589 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.646960 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.651576 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.651576 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.651576 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.651576 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.651576 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.651576 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.651576 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.651576 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.653045 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.653045 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.653045 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.653045 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.653045 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.653045 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.653045 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.653045 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.654470 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.654470 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.654470 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.654470 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.654470 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.654470 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.655766 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.655766 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.655766 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.655766 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.656342 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.656342 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.656618 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.656848 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.657178 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.657492 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.657805 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.658118 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.658431 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.658765 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.659076 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.659409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.659740 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.660058 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.660367 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.660693 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.661008 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.661321 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.661645 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.661953 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.662266 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.662791 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.662970 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.663319 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.663656 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.663969 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.664290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.664603 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.665307 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.665307 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.665694 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.665912 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.666147 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.666519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.666817 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.667129 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.667481 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.667829 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.668168 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.668526 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.668981 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.669183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.669508 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.669838 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.670169 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.670487 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.670822 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.671842 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.671842 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.671842 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.672229 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.672508 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.673649 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.674071 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.674287 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.674618 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.674955 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.675289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.675655 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.680454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.680454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.680454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.680454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.680454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.680454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.680454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.680454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.681495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.681495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.681495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.681495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.681495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.681495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.681495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.681495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.682401 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.682401 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.682401 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.682401 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.682886 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.682886 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.683164 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.683933 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.683933 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.684234 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.684499 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.684769 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.685082 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.685395 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.685712 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.686285 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.686617 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.686956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.687269 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.687645 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.687967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.688285 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.688606 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.688990 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.689310 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.689635 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.689972 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.690417 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.690686 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.690910 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.691165 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.691883 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.691883 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.692378 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.692612 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.692851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.693265 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.693497 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.694282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.694539 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.695005 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.695246 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.696901 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.696901 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.696901 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.696901 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.696901 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.698101 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.698101 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.698101 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.698101 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.699040 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.699040 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.699040 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.699899 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.699899 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.699899 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.700662 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.700662 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.701384 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.701384 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.701901 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.701901 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.702348 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.702348 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.702806 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.703047 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.703387 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.705804 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.705804 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.705804 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.705804 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.705804 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.705804 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.705804 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.707340 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.707340 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.707340 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.707340 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.707340 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.708554 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.708554 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.708554 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.708554 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.710136 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.710136 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.710136 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.710799 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.710799 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.710799 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.711741 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.711741 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.711741 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.712974 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.712974 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.712974 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.712974 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.714414 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.714414 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.714414 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.714414 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.715529 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.715529 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.715529 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.715529 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.717823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.717823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.717823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.717823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.717823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.717823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.717823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.719387 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.719387 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.719387 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.719387 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.719387 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.721537 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.721537 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.721537 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.721537 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.721537 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.721537 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.721537 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.723143 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.723143 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.723143 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.723143 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.723143 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.724297 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.724297 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.724297 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.724297 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.726770 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.726770 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.726770 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.726770 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.726770 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.726770 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.728191 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.728191 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.728191 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.728191 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.729116 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.729116 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.729116 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.729772 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.729772 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.731480 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.731480 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.731480 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.731480 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.731480 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.731480 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.732814 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.732814 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.732814 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.732814 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.733710 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.733710 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.734181 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.734181 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.734637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.734886 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.735339 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.735339 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.737362 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.737362 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.737362 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.737362 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.737362 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.737362 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.738723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.738723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.738723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.738723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.738723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.739859 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.739859 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.739859 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.741744 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.741744 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.741744 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.741744 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.741744 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.742901 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.742901 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.742901 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.742901 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.743809 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.743809 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.744255 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.744255 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.745410 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.745410 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.745410 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.745410 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.746381 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.746381 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.746381 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.747145 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.747145 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.747652 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.747652 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.748109 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.748332 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.748584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.748812 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.749066 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.749364 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.749687 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.750004 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.750314 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.751012 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.751012 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.751551 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.751551 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.752003 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.752235 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.752474 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.752757 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.753067 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.753380 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.754401 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.754401 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.754401 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.756036 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.756036 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.756036 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.756036 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.756036 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.758106 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.758106 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.758106 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.758106 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.758106 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.759229 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.759229 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.759229 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.759928 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.759928 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.759928 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.760595 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.760595 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.761514 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.761514 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.761514 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.762210 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.762210 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.762677 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.762677 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.763121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.763449 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.763739 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.764004 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.764253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.764530 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.764854 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.765172 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.766240 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.766240 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.766240 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.766922 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.766922 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.767482 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.767482 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.768100 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.768100 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.768550 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.768550 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.769025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.769276 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.769510 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.770026 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.770280 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.771764 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.771764 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.771764 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.771764 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.771764 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.773502 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.773502 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.773502 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.774200 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.774200 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.774200 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.774899 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.774899 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.777088 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.777088 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.777088 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.777088 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.777088 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.777088 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.777088 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.778786 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.778786 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.778786 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.778786 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.778786 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.779936 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.779936 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.779936 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.779936 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.780897 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.780897 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.780897 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.781865 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.781865 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.781865 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.782530 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.782530 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.783007 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.783007 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.783509 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.783509 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.783950 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.784203 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.784571 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.784887 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.785197 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.785622 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.785939 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.786255 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.787339 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.787339 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.787339 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.788880 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.788880 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.788880 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.789593 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.789593 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.790068 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.790339 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.790752 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.790752 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.791254 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.791836 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.791836 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.792288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.792534 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.792765 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.793075 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.793475 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.793716 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.794003 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.794322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.794640 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.794951 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.795280 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.795618 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.795936 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.796251 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.796568 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.797735 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.797735 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.797735 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.798562 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.798562 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.798562 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.799264 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.799264 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.799775 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.799775 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.800233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.800461 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.800724 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.801090 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.801335 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.801585 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.802128 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.802128 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.802587 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.802815 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.803120 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.804065 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.804575 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.804908 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.805240 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.805552 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.805867 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.806223 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.806485 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.806797 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.808007 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.808007 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.808007 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.808007 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.809307 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.809307 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.809307 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.809307 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.810199 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.810199 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.810199 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.810867 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.810867 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.811805 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.811805 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.814063 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.814063 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.814063 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.814063 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.814063 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.814063 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.814063 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.815970 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.815970 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.815970 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.815970 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.815970 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.815970 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.817368 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.817368 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.817368 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.817368 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.819865 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.819865 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.819865 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.819865 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.819865 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.819865 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.821166 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.821166 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.821166 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.821166 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.821166 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.822738 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.822738 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.822738 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.822738 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.822738 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.823899 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.823899 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.823899 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.824576 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.824576 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.825028 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.825028 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.825459 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.825678 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.825899 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.826200 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.826518 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.826841 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.827162 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.827505 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.828234 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.828234 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.829096 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.829096 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.829545 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.829545 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.830088 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.830368 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.830703 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.831053 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.831411 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.831878 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.832117 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.832385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.832917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.833178 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.833412 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.833645 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.833964 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.834275 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.835169 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.835606 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.835926 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.836416 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.836675 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.837174 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.837537 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.837867 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.838656 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.838656 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.839597 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.839597 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.839597 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.840482 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.840482 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.840482 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.841173 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.841173 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.841643 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.841643 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.842274 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.842274 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.844846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.844846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.844846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.844846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.844846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.844846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.844846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.844846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.846549 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.846549 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.846549 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.846549 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.846549 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.846549 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.847948 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.847948 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.847948 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.847948 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.849410 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.849410 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.849410 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.849410 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.849410 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.852519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.852519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.852519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.852519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.852519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.852519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.852519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.854417 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.854417 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.854417 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.854417 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.854417 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.854417 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.855814 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.855814 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.855814 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.855814 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.856771 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.856771 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.856771 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.857542 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.857542 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.857542 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.858273 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.858273 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.859258 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.859258 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.859258 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.859258 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.860629 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.860629 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.860629 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.860629 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.861546 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.861546 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.861546 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.862422 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.862422 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.862422 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.863234 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.863234 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.863796 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.863796 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.864571 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.864571 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.865022 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.865022 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.865468 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.865781 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.866727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.867066 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.867409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.867750 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.868106 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.868446 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.868782 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.869528 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.869528 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.871250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.871250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.871250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.871250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.871250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.871250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.872996 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.872996 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.872996 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.872996 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.872996 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.874204 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.874204 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.874204 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.874204 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.875441 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.875441 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.875441 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.875441 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.875441 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.876494 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.876494 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.876494 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.877108 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.877108 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.877515 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.877721 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.877941 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.878264 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.878587 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.878904 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.879664 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.879664 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.880140 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.880354 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.880943 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.880943 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.881894 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.882270 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.882532 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.882824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.883234 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.883614 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.883938 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.884377 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.884694 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.885187 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.885445 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.885699 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.885937 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.886199 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.886476 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.886794 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.887118 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.887465 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.887786 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.888157 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.888400 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.888747 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.889080 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.889899 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.889899 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.890386 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.890386 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.891234 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.891234 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.891777 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.891777 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.892257 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.892665 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:58.892665 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 08:50:58.958303 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO dbcounter [None req-5c78070d-0bdd-42f6-9671-1d4fe670c91f None None] Registered counter for database nova_api Jun 17 08:50:58.979802 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_db.sqlalchemy.engines [None req-5c78070d-0bdd-42f6-9671-1d4fe670c91f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:50:58.986320 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 08:50:58.986857 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 08:50:58.987128 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 08:50:58.987520 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 08:50:58.987775 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 08:50:58.988101 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writer thread running {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:50:58.988215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.988483 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.988808 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.989128 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.989462 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.989774 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.990100 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.990423 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.991295 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.991595 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.992204 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.992542 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-33-iscsi {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.992866 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.993176 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.993491 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.993815 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.994120 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.994442 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.994748 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.995266 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.995615 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.995924 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.996235 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.996573 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.996888 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.997201 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.997519 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.997829 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.998152 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.998461 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.998864 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-33-iscsi {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.999181 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.999529 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:58.999849 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.000268 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.000580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.000891 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.001211 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.001533 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.001844 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.002173 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.002498 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.002816 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.003136 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.003483 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.003774 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.004085 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.004403 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.004709 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.005013 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.005263 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.005686 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.006036 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.006951 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.007299 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.007644 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.007845 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.008166 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.008492 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.008804 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.009116 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.009429 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.009740 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.010050 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.010358 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.010664 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.010971 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.012657 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.012657 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.012657 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.012657 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.012657 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.013048 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.013200 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.013509 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.013855 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.014175 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.014489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.014810 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.015131 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.015475 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.015791 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.016098 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.016418 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.016991 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.017100 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.017290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.017683 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.017991 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.018312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.018619 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.018926 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.019233 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.019560 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.019870 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.020177 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.020483 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.020789 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.021095 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.021397 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.021703 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.022044 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.022358 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.022679 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.023001 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.023307 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.023639 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.023946 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.024253 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.024573 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.024878 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.025184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.025504 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.025811 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.026118 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.026438 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.026747 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.027056 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.027520 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.027830 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.028138 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.028456 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.028765 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.029073 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.029424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.029734 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.030041 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.030348 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.030654 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.030960 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.031262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.031607 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.031928 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.032245 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.032554 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.032860 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.033179 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:50:59.033522 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.033854 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.034198 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.034516 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.034852 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.035184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.035534 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.035851 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.036170 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.036498 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.036813 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.037127 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.037523 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.037923 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.038248 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.038582 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.038904 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.039223 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.039569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.039888 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.040211 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.040542 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.040869 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.041184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.041526 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.041873 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.042197 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.042526 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.042854 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.043171 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.043509 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.043826 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.044154 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.044489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.044806 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.045126 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.045441 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.045756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.046071 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.046386 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.046681 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.context [None req-5c78070d-0bdd-42f6-9671-1d4fe670c91f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4ac623a5-dc81-4845-8d0c-a315180756a6(cell1) {{(pid=129876) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 08:50:59.046789 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.047026 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.047377 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.047685 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.047999 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.048317 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.048630 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.048942 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.049253 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.049557 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.049861 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.050165 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.050476 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.050783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.050877 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5c78070d-0bdd-42f6-9671-1d4fe670c91f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:59.051105 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.051459 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.051768 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.052111 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.052417 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.052511 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5c78070d-0bdd-42f6-9671-1d4fe670c91f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:59.052729 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.053604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.053874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.054007 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5c78070d-0bdd-42f6-9671-1d4fe670c91f None None] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:59.054182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.054496 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.054808 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.055113 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.055470 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.055788 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.055910 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5c78070d-0bdd-42f6-9671-1d4fe670c91f None None] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:59.056096 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.056418 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.056725 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.057031 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.057347 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.057662 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.057945 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO dbcounter [None req-5c78070d-0bdd-42f6-9671-1d4fe670c91f None None] Registered counter for database nova_cell0 Jun 17 08:50:59.058041 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.058274 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.058586 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.058911 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.059226 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.059677 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.060012 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.060348 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.060656 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.061242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.061562 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.061877 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.062189 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.062290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO dbcounter [None req-5c78070d-0bdd-42f6-9671-1d4fe670c91f None None] Registered counter for database nova_cell1 Jun 17 08:50:59.062500 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.062803 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.063107 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.063434 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.063746 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.064048 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.064355 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.064660 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.064961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.065266 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.065587 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.065901 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.066204 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.066503 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.066805 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.067154 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.067494 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.067840 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.068179 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.068499 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.069360 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.069686 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.070007 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.070198 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_db.sqlalchemy.engines [None req-5c78070d-0bdd-42f6-9671-1d4fe670c91f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:50:59.070365 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.070623 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.070934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.071243 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.071596 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.071908 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.072234 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.072546 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.072869 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.073180 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.073500 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.073807 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.074018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_db.sqlalchemy.engines [None req-5c78070d-0bdd-42f6-9671-1d4fe670c91f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:50:59.074116 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.074453 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.074793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.075110 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.075459 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.075774 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.076090 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.076400 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.076711 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.077020 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.077331 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.077646 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.077959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.078277 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.078587 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.078910 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.079219 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.079560 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.079863 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.080179 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.080511 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.080790 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writer thread running {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:50:59.080954 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.081125 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.081445 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.081765 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.082004 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writer thread running {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:50:59.082171 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.082381 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.082695 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.083000 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.083305 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.083644 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.083960 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.084273 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.084621 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.084927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.085241 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.085551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.085856 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.086159 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.086471 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.086793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.087103 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.087450 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.087776 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.088081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.088387 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.088712 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.089027 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.089329 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.089632 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.089938 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.090284 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.090601 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.090908 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.091228 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.091573 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.091888 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.092210 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.092626 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.093204 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.093533 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.093854 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.094165 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.094477 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.094789 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.095098 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.095432 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.095758 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.096068 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.096379 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.096690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.096995 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.097304 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.097626 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.098200 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.098532 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.098849 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.099169 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.099515 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.099838 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.100204 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.100533 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.100872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.101194 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.101467 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.101775 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.102082 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.102399 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.102702 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.103006 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.103311 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.103649 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.103952 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.104258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.104562 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.105288 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.105614 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.105923 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.106236 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.106542 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.106866 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.107179 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.107504 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.107838 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.108143 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.108486 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.108795 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.109132 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.109459 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.109798 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.110102 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.110405 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.110729 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.111033 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.111338 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.111663 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.111973 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.112290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.112592 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.112901 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.113210 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.113520 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.113829 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.114131 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.114438 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.114742 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.115055 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.115380 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.116324 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.116751 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.116974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.117128 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.117388 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.117698 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.118003 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.118321 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.118628 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.118934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.119238 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.119574 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.119884 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.120189 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.120511 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.120822 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.121125 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.121429 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.121738 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.122042 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.122348 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.122659 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.122980 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.123295 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.123625 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.123935 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.124238 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.124542 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.124849 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.125152 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.125455 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.125757 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.126056 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.126359 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.126663 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.126988 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.127297 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.127625 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.127930 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.128234 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.128580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.128886 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.129244 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.129551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.129866 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.130184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.130494 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.130806 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.131118 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.131999 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.132326 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.132639 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.133263 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.133575 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.133881 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.134202 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.134514 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.134824 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.135145 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.135492 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.135818 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.136122 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.136434 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.136745 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.137055 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.137364 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.137673 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.137984 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.138391 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.138592 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.139180 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.139523 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.139830 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.140141 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.140452 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.140755 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.141079 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.141390 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.141691 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.142027 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.142338 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.142649 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.142952 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.143423 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.143719 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.144030 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.144335 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.144646 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.144957 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.145271 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.145583 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.145888 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.146306 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.146616 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.146951 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.147262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.147594 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.147898 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.148203 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.148525 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.148829 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.149132 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.149434 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.149756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.150059 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.150378 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.150789 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.151102 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.151435 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.151853 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.152171 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.152483 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.152805 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.153123 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.153446 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.153755 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.154058 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.154565 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.154895 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.155220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.155563 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.155879 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.156185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.156509 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.156831 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.157145 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.157465 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.157884 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.158208 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.158519 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.158840 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.159167 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.159499 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.159805 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.160118 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.160424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.160728 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.161050 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.161354 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.161665 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.161973 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.162283 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.162725 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.163188 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.163550 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.163855 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.164178 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.164494 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.164818 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.165141 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.165448 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.165771 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.166081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.166384 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.166687 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.166989 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.167332 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.167660 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.167982 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.168311 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.168636 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.168947 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.169280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.169607 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.169924 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.170241 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.170564 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.170871 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.171172 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.171507 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.171815 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.172120 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.172427 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.172735 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.173036 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.173337 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.173636 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.173956 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.174256 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.174576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.174883 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.175184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.175510 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.175811 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.176150 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.176451 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.176781 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.177100 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.177421 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.178654 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.179083 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.179504 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.179901 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.180221 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.180540 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.180858 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.181173 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.181488 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.181804 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.182114 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.182428 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.182746 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.183070 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.183662 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.183996 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.184313 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.184629 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.184951 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.185262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.185577 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.186134 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.186455 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.186766 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.187081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.187501 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.187831 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.188158 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.188498 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.188818 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.189134 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.189463 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.189850 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.190129 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.190444 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.190753 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.191067 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.191393 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.191720 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.192035 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.192348 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.192662 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.192982 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.193295 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.193604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.194852 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.195178 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.195552 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.195894 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.196221 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.196538 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.196856 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.197175 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.197704 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.198025 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.198360 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.198687 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.199013 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.199331 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.199675 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.200003 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.200305 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.200652 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.200914 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.201225 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.201530 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.201856 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.202205 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.202502 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.202829 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.203143 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.203713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.204063 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.204381 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.204706 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.205031 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.205350 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.205659 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.205983 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.206290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.206594 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.206909 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.207218 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.207553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.207859 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.208172 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.208558 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.208789 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.209103 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.209436 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.209762 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.210073 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.210372 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.210677 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.210988 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.211292 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.211628 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.211936 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.212240 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.212554 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.212864 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.213175 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.213478 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.213789 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.214094 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.214402 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.214756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.215080 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.215404 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.215713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.216031 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.216342 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.216664 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.216980 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.217290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.217638 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.217956 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.218516 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.218859 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.219183 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.219552 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.219887 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.220197 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.220506 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.220815 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.221141 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.221455 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.221761 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.222076 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.222386 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.222696 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.223014 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.223323 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.223659 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.223971 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.224280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.224588 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.224898 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.225352 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.225671 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.226015 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.226334 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.226649 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.226964 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.227281 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.227649 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.227962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.228273 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.228583 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.228899 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.229226 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.229541 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.229847 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.230274 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.230589 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.230908 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.231228 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.231563 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.231904 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.232206 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.232517 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.232844 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.233152 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.233481 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.233824 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.234151 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.234475 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.234783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.235088 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.235410 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.235721 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.236041 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.236349 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.236656 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.236956 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.237264 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.237567 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.237870 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.238173 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.238477 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.238784 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.239085 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.239405 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.239709 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.240013 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.240314 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.241126 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.241437 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.241736 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.242038 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.242333 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.242634 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.242942 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.243273 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.243628 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.243944 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.244265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.244573 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.244893 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.245201 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.245535 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.245854 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.246170 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.246476 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.246805 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.247115 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.247451 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.247761 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.248072 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.248381 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.248690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.249015 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.249326 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.249627 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.249951 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.250263 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.250580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.250893 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.251200 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.251555 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.251869 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.252174 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.252488 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.252801 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.253112 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.253424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.253740 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.254066 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.254389 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.254700 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.255025 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.255371 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.255724 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.256036 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.256932 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.257266 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.257602 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.257994 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.258301 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:50:59.258546 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 08:50:59.290726 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO dbcounter [None req-5c78070d-0bdd-42f6-9671-1d4fe670c91f None None] Registered counter for database nova_cell0 Jun 17 08:50:59.297744 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_db.sqlalchemy.engines [None req-5c78070d-0bdd-42f6-9671-1d4fe670c91f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:50:59.302386 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writer thread running {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:50:59.323140 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO dbcounter [None req-3a87c6a1-fdaa-4347-9506-a7ca43572de9 None None] Registered counter for database nova_api Jun 17 08:50:59.343061 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_db.sqlalchemy.engines [None req-3a87c6a1-fdaa-4347-9506-a7ca43572de9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:50:59.350815 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writer thread running {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:50:59.410564 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.context [None req-3a87c6a1-fdaa-4347-9506-a7ca43572de9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4ac623a5-dc81-4845-8d0c-a315180756a6(cell1) {{(pid=129875) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 08:50:59.416007 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3a87c6a1-fdaa-4347-9506-a7ca43572de9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:59.417644 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3a87c6a1-fdaa-4347-9506-a7ca43572de9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:59.418484 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3a87c6a1-fdaa-4347-9506-a7ca43572de9 None None] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:59.420496 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3a87c6a1-fdaa-4347-9506-a7ca43572de9 None None] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:59.422553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO dbcounter [None req-3a87c6a1-fdaa-4347-9506-a7ca43572de9 None None] Registered counter for database nova_cell0 Jun 17 08:50:59.426588 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO dbcounter [None req-3a87c6a1-fdaa-4347-9506-a7ca43572de9 None None] Registered counter for database nova_cell1 Jun 17 08:50:59.435816 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_db.sqlalchemy.engines [None req-3a87c6a1-fdaa-4347-9506-a7ca43572de9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:50:59.438232 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_db.sqlalchemy.engines [None req-3a87c6a1-fdaa-4347-9506-a7ca43572de9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:50:59.447090 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writer thread running {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:50:59.449059 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writer thread running {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:50:59.616675 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO dbcounter [None req-3a87c6a1-fdaa-4347-9506-a7ca43572de9 None None] Registered counter for database nova_cell0 Jun 17 08:50:59.624276 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_db.sqlalchemy.engines [None req-3a87c6a1-fdaa-4347-9506-a7ca43572de9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:50:59.625111 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: WARNING keystonemiddleware.auth_token [None req-5c78070d-0bdd-42f6-9671-1d4fe670c91f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 08:50:59.629514 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writer thread running {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:50:59.632671 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: WARNING keystonemiddleware.auth_token [None req-5c78070d-0bdd-42f6-9671-1d4fe670c91f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 08:50:59.970203 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: WARNING keystonemiddleware.auth_token [None req-3a87c6a1-fdaa-4347-9506-a7ca43572de9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 08:50:59.979069 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: WARNING keystonemiddleware.auth_token [None req-3a87c6a1-fdaa-4347-9506-a7ca43572de9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 08:50:59.979317 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: WARNING keystonemiddleware.auth_token [None req-5c78070d-0bdd-42f6-9671-1d4fe670c91f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 08:50:59.985347 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: WARNING keystonemiddleware.auth_token [None req-5c78070d-0bdd-42f6-9671-1d4fe670c91f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 08:50:59.990819 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e163b999c0 pid: 129876 (default app) Jun 17 08:51:00.346057 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: WARNING keystonemiddleware.auth_token [None req-3a87c6a1-fdaa-4347-9506-a7ca43572de9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 08:51:00.353031 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: WARNING keystonemiddleware.auth_token [None req-3a87c6a1-fdaa-4347-9506-a7ca43572de9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 08:51:00.358453 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e163b999c0 pid: 129875 (default app) Jun 17 08:51:41.425115 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_api:SELECT=3 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:41.426209 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=3 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:41.427095 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=3 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:41.427834 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=3 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:41.790513 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=3 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:41.791632 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=3 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:41.792699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=3 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:41.793595 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=3 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:42.906205 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-fb786912-2b62-445b-8d4a-39c76597e3ff tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Action: 'create', calling method: .version_select at 0x7fbc41b1c8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-610718966"}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:51:43.421356 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-dcd5fa41-84b0-4705-9388-3227d8689846 tempest-VolumesGetTestJSON-1245697272 tempest-VolumesGetTestJSON-1245697272-project] Action: 'create', calling method: .version_select at 0x7fbc41ad3700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-610432446", "metadata": {"Type": "work"}}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:51:46.106623 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-fb786912-2b62-445b-8d4a-39c76597e3ff tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.690812 Jun 17 08:51:46.115302 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 1/1] 10.222.0.78 () {60 vars in 1154 bytes} [Fri Jun 17 08:51:41 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4701 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 17 08:51:46.121525 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-87edd45f-9328-46db-9b8c-fa40e8a83eaf tempest-VolumesTestJSON-2004235675 tempest-VolumesTestJSON-2004235675-project] Calling method '.version_select at 0x7fbc419e6700>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:46.274427 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-dcd5fa41-84b0-4705-9388-3227d8689846 tempest-VolumesGetTestJSON-1245697272 tempest-VolumesGetTestJSON-1245697272-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.493151 Jun 17 08:51:46.275094 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 1/2] 10.222.0.78 () {60 vars in 1155 bytes} [Fri Jun 17 08:51:41 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4496 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 17 08:51:46.281977 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-02829339-830f-4912-a3d5-cd4f6051cd60 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Calling method '.version_select at 0x7fbc4199c550>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:46.348616 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-87edd45f-9328-46db-9b8c-fa40e8a83eaf tempest-VolumesTestJSON-2004235675 tempest-VolumesTestJSON-2004235675-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6866d6b3-a258-45e1-ac45-932a8caef78a" status: 200 len: 351 microversion: 2.1 time: 0.231966 Jun 17 08:51:46.356157 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 2/3] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jun 17 08:51:46 2022] GET /compute/v2.1/os-volumes/6866d6b3-a258-45e1-ac45-932a8caef78a => generated 351 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:51:46.366689 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-faba33b9-1ad2-49a0-a4ce-25940024cdd1 tempest-VolumesGetTestJSON-1245697272 tempest-VolumesGetTestJSON-1245697272-project] Calling method '.version_select at 0x7fbc419e6820>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:46.640964 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-02829339-830f-4912-a3d5-cd4f6051cd60 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/89240a88-ac16-4a66-93be-23eb2a69d778" status: 200 len: 345 microversion: 2.1 time: 0.364382 Jun 17 08:51:46.642157 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 2/4] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jun 17 08:51:46 2022] GET /compute/v2.1/os-volumes/89240a88-ac16-4a66-93be-23eb2a69d778 => generated 345 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:51:46.653510 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-babf68fe-ee94-4d64-9669-54d0f60dd060 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Action: 'create', calling method: .version_select at 0x7fbc4199cb80>, body: {"snapshot": {"volume_id": "89240a88-ac16-4a66-93be-23eb2a69d778", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1965928487"}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:51:46.936384 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-faba33b9-1ad2-49a0-a4ce-25940024cdd1 tempest-VolumesGetTestJSON-1245697272 tempest-VolumesGetTestJSON-1245697272-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/bf70ba33-c808-444c-aa7a-b88f3c7d2fea" status: 200 len: 353 microversion: 2.1 time: 0.395355 Jun 17 08:51:46.936384 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 3/5] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jun 17 08:51:46 2022] GET /compute/v2.1/os-volumes/bf70ba33-c808-444c-aa7a-b88f3c7d2fea => generated 353 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:51:46.936384 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-c6f30c20-a2bf-4db4-a777-e6a1d36c9e4e tempest-VolumesGetTestJSON-1245697272 tempest-VolumesGetTestJSON-1245697272-project] Calling method '.version_select at 0x7fbc419e6f70>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:48.368049 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-babf68fe-ee94-4d64-9669-54d0f60dd060 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] 10.222.0.78 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.717518 Jun 17 08:51:48.370613 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 3/6] 10.222.0.78 () {60 vars in 1161 bytes} [Fri Jun 17 08:51:46 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:51:48.389424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-eed54c49-3564-41e2-955d-ba80af69fc8e tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Calling method '.version_select at 0x7fbc419b3310>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:48.437900 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-c6f30c20-a2bf-4db4-a777-e6a1d36c9e4e tempest-VolumesGetTestJSON-1245697272 tempest-VolumesGetTestJSON-1245697272-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/bf70ba33-c808-444c-aa7a-b88f3c7d2fea" status: 200 len: 353 microversion: 2.1 time: 1.674864 Jun 17 08:51:48.438572 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 4/7] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jun 17 08:51:46 2022] GET /compute/v2.1/os-volumes/bf70ba33-c808-444c-aa7a-b88f3c7d2fea => generated 353 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:51:48.463080 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-561389f1-2d23-406e-8100-16899c9830ea tempest-VolumesGetTestJSON-1245697272 tempest-VolumesGetTestJSON-1245697272-project] Calling method '.version_select at 0x7fbc419fd670>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:48.570731 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-eed54c49-3564-41e2-955d-ba80af69fc8e tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/17e91f43-2418-4fbd-8ab0-6d6d70662ddd" status: 200 len: 287 microversion: 2.1 time: 0.192547 Jun 17 08:51:48.572444 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 4/8] 10.222.0.78 () {58 vars in 1250 bytes} [Fri Jun 17 08:51:48 2022] GET /compute/v2.1/os-snapshots/17e91f43-2418-4fbd-8ab0-6d6d70662ddd => generated 287 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:51:48.581342 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-cd6a182c-f91d-4217-8894-196f2b549293 tempest-VolumesTestJSON-2004235675 tempest-VolumesTestJSON-2004235675-project] Calling method '.version_select at 0x7fbc419b3a60>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:48.828259 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-561389f1-2d23-406e-8100-16899c9830ea tempest-VolumesGetTestJSON-1245697272 tempest-VolumesGetTestJSON-1245697272-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/bf70ba33-c808-444c-aa7a-b88f3c7d2fea" status: 202 len: 0 microversion: 2.1 time: 0.372668 Jun 17 08:51:48.829302 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 5/9] 10.222.0.78 () {58 vars in 1247 bytes} [Fri Jun 17 08:51:48 2022] DELETE /compute/v2.1/os-volumes/bf70ba33-c808-444c-aa7a-b88f3c7d2fea => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 08:51:48.834400 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-7169706a-3289-4b2b-8c84-4500e51a6c4f tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Calling method '.version_select at 0x7fbc419e6ca0>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:48.932848 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-cd6a182c-f91d-4217-8894-196f2b549293 tempest-VolumesTestJSON-2004235675 tempest-VolumesTestJSON-2004235675-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/35dd30d7-5dcc-4847-a126-a59aa957fcaa" status: 200 len: 351 microversion: 2.1 time: 0.358399 Jun 17 08:51:48.934206 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 5/10] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jun 17 08:51:48 2022] GET /compute/v2.1/os-volumes/35dd30d7-5dcc-4847-a126-a59aa957fcaa => generated 351 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:51:48.951097 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d93fe035-68b6-4c93-81b9-30c60db490be tempest-VolumesGetTestJSON-1245697272 tempest-VolumesGetTestJSON-1245697272-project] Calling method '.version_select at 0x7fbc4199c8b0>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:49.173418 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-7169706a-3289-4b2b-8c84-4500e51a6c4f tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.342779 Jun 17 08:51:49.174181 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 6/11] 10.222.0.78 () {58 vars in 1139 bytes} [Fri Jun 17 08:51:48 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:51:49.184620 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-40306ac3-09db-4379-81a2-adda4a447d69 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Calling method '.version_select at 0x7fbc419fd700>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:50.009108 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-40306ac3-09db-4379-81a2-adda4a447d69 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/17e91f43-2418-4fbd-8ab0-6d6d70662ddd" status: 200 len: 287 microversion: 2.1 time: 0.828120 Jun 17 08:51:50.009695 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 7/12] 10.222.0.78 () {58 vars in 1250 bytes} [Fri Jun 17 08:51:49 2022] GET /compute/v2.1/os-snapshots/17e91f43-2418-4fbd-8ab0-6d6d70662ddd => generated 287 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:51:50.026602 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-d93fe035-68b6-4c93-81b9-30c60db490be tempest-VolumesGetTestJSON-1245697272 tempest-VolumesGetTestJSON-1245697272-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/bf70ba33-c808-444c-aa7a-b88f3c7d2fea" status: 200 len: 352 microversion: 2.1 time: 1.091094 Jun 17 08:51:50.032855 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 6/13] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jun 17 08:51:48 2022] GET /compute/v2.1/os-volumes/bf70ba33-c808-444c-aa7a-b88f3c7d2fea => generated 352 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:51:51.022909 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-0cbc80c5-c107-44fd-a4e6-3481e29aea2e tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Calling method '.version_select at 0x7fbc419fdd30>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:51.044551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-6bd3b98b-bc49-4ca3-b72c-07346bd4ddec tempest-VolumesGetTestJSON-1245697272 tempest-VolumesGetTestJSON-1245697272-project] Calling method '.version_select at 0x7fbc4199cb80>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:51.089166 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-0cbc80c5-c107-44fd-a4e6-3481e29aea2e tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/17e91f43-2418-4fbd-8ab0-6d6d70662ddd" status: 200 len: 287 microversion: 2.1 time: 0.071629 Jun 17 08:51:51.089744 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 8/14] 10.222.0.78 () {58 vars in 1250 bytes} [Fri Jun 17 08:51:51 2022] GET /compute/v2.1/os-snapshots/17e91f43-2418-4fbd-8ab0-6d6d70662ddd => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:51:51.145995 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-6bd3b98b-bc49-4ca3-b72c-07346bd4ddec tempest-VolumesGetTestJSON-1245697272 tempest-VolumesGetTestJSON-1245697272-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/bf70ba33-c808-444c-aa7a-b88f3c7d2fea" status: 200 len: 352 microversion: 2.1 time: 0.106254 Jun 17 08:51:51.147623 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 7/15] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jun 17 08:51:51 2022] GET /compute/v2.1/os-volumes/bf70ba33-c808-444c-aa7a-b88f3c7d2fea => generated 352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:51:52.104220 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-773fb111-45cb-4837-afa8-d7490f239c5a tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Calling method '.version_select at 0x7fbc419fd040>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:52.157972 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-773fb111-45cb-4837-afa8-d7490f239c5a tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/17e91f43-2418-4fbd-8ab0-6d6d70662ddd" status: 200 len: 287 microversion: 2.1 time: 0.060901 Jun 17 08:51:52.158624 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 9/16] 10.222.0.78 () {58 vars in 1250 bytes} [Fri Jun 17 08:51:52 2022] GET /compute/v2.1/os-snapshots/17e91f43-2418-4fbd-8ab0-6d6d70662ddd => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:51:52.159972 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-137c03df-825c-491d-ba06-8c12885d1272 tempest-VolumesGetTestJSON-1245697272 tempest-VolumesGetTestJSON-1245697272-project] Calling method '.version_select at 0x7fbc419b3790>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:52.260769 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-137c03df-825c-491d-ba06-8c12885d1272 tempest-VolumesGetTestJSON-1245697272 tempest-VolumesGetTestJSON-1245697272-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/bf70ba33-c808-444c-aa7a-b88f3c7d2fea" status: 200 len: 352 microversion: 2.1 time: 0.106072 Jun 17 08:51:52.261777 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 8/17] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jun 17 08:51:52 2022] GET /compute/v2.1/os-volumes/bf70ba33-c808-444c-aa7a-b88f3c7d2fea => generated 352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:51:53.173449 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-93c8042c-5d21-43fe-823e-5e48d4c52847 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Calling method '.version_select at 0x7fbc419b31f0>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:53.214938 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-b0d842e4-2197-4453-8f95-4b76a9b58638 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Action: 'create', calling method: .version_select at 0x7fbc419fd5e0>, body: {"keypair": {"name": "tempest-keypair-1109878213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBID/u8hdQiderQfo82Hka14dfa9DfhH+FHf+SKSXe8ghzr46Pg9CHvYmsZjlbvydfmPvEdldw1wGFr5GI1LhMJBgmMzWxucohj+tn8KXxt4ORmtBdIgIbVzu7ntEiUX5wA=="}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:51:53.341512 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-93c8042c-5d21-43fe-823e-5e48d4c52847 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/17e91f43-2418-4fbd-8ab0-6d6d70662ddd" status: 200 len: 288 microversion: 2.1 time: 0.174835 Jun 17 08:51:53.344387 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 9/18] 10.222.0.78 () {58 vars in 1250 bytes} [Fri Jun 17 08:51:53 2022] GET /compute/v2.1/os-snapshots/17e91f43-2418-4fbd-8ab0-6d6d70662ddd => generated 288 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:51:53.350635 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3a039ff9-48ff-4296-a93e-323bd525c6c2 tempest-VolumesGetTestJSON-1245697272 tempest-VolumesGetTestJSON-1245697272-project] Calling method '.version_select at 0x7fbc419b3280>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:53.375633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-b0d842e4-2197-4453-8f95-4b76a9b58638 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Getting quotas for project 794e7ebcf5c3436081b8e8d39907b655. Resources: {'key_pairs'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:51:53.401495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-b0d842e4-2197-4453-8f95-4b76a9b58638 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Getting quotas for user 01bb3df8b4b649388d1a0f6c24e18f1b and project 794e7ebcf5c3436081b8e8d39907b655. Resources: {'key_pairs'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:51:53.653663 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-b0d842e4-2197-4453-8f95-4b76a9b58638 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.566990 Jun 17 08:51:53.658264 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 10/19] 10.222.0.78 () {60 vars in 1158 bytes} [Fri Jun 17 08:51:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:51:53.665881 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a9994dc3-4e03-4e0a-b0d3-ccae8a8ef3d0 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Calling method '.version_select at 0x7fbc4195fd30>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:53.707433 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-3a039ff9-48ff-4296-a93e-323bd525c6c2 tempest-VolumesGetTestJSON-1245697272 tempest-VolumesGetTestJSON-1245697272-project] HTTP exception thrown: Volume bf70ba33-c808-444c-aa7a-b88f3c7d2fea could not be found. Jun 17 08:51:53.712239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3a039ff9-48ff-4296-a93e-323bd525c6c2 tempest-VolumesGetTestJSON-1245697272 tempest-VolumesGetTestJSON-1245697272-project] Request method failure captured: Jun 17 08:51:53.712239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: GET /compute/v2.1/os-volumes/bf70ba33-c808-444c-aa7a-b88f3c7d2fea HTTP/1.1 Jun 17 08:51:53.712239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 08:51:53.712239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 08:51:53.712239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 08:51:53.712239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 08:51:53.712239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 08:51:53.712239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 08:51:53.712239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 08:51:53.712239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 08:51:53.712239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirECdgGYEdro1htfb2KM4vgSC2min6s1C3s6w0aLPZxI60TKMQDWob1eAt7e-MIMfTZ75njvX6TlYedeyiEKiIL0nQTqJlxvPtoqFHLzhT5ssBm5kOzhSP3eaTcVfqhawnC-b4q8EUgOXfOwNg9lnTs-NMgMRy_hJMFhlgutHV_Xahxc Jun 17 08:51:53.712239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 08:51:53.712239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 08:51:53.712239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 08:51:53.712239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 08:51:53.712239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 08:51:53.712239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 08:51:53.712239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: 2bfcf91b0c2b42ccab1c652c7b7fd5ac Jun 17 08:51:53.712239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-VolumesGetTestJSON-1245697272 Jun 17 08:51:53.712239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 08:51:53.712239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 08:51:53.713300 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2bfcf91b0c2b42ccab1c652c7b7fd5ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2bfcf91b0c2b42ccab1c652c7b7fd5ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2bfcf91b0c2b42ccab1c652c7b7fd5ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2bfcf91b0c2b42ccab1c652c7b7fd5ac"}]}] Jun 17 08:51:53.713300 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-VolumesGetTestJSON-1245697272 Jun 17 08:51:53.713300 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: 2bfcf91b0c2b42ccab1c652c7b7fd5ac Jun 17 08:51:53.713300 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-VolumesGetTestJSON-1245697272 Jun 17 08:51:53.713300 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-VolumesGetTestJSON-1245697272-project Jun 17 08:51:53.713300 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 08:51:53.713300 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 08:51:53.713300 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: 5a6152b8f4cd472a983a5e87eab11391 Jun 17 08:51:53.713300 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-VolumesGetTestJSON-1245697272-project Jun 17 08:51:53.713300 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: Jun 17 08:51:53.713300 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Volume bf70ba33-c808-444c-aa7a-b88f3c7d2fea could not be found. Jun 17 08:51:53.713300 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'id': 'bf70ba33-c808-444c-aa7a-b88f3c7d2fea'} Jun 17 08:51:53.713300 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:51:53.713934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:51:53.713934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:51:53.713934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:51:53.713934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 08:51:53.713934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 08:51:53.713934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 08:51:53.713934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 08:51:53.713934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 08:51:53.713934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 08:51:53.713934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 08:51:53.713934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 08:51:53.713934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:51:53.713934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:51:53.713934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:51:53.713934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:51:53.713934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bf70ba33-c808-444c-aa7a-b88f3c7d2fea could not be found. (HTTP 404) (Request-ID: req-b0fdbc7d-379b-4302-9bee-f8652fd6f4fb) Jun 17 08:51:53.713934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:51:53.713934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:51:53.713934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:51:53.714796 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:51:53.714796 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 08:51:53.714796 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 08:51:53.714796 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 08:51:53.714796 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 08:51:53.714796 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 08:51:53.714796 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 08:51:53.714796 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 08:51:53.714796 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 08:51:53.714796 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:51:53.714796 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:51:53.714796 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 08:51:53.714796 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 08:51:53.714796 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 08:51:53.714796 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 08:51:53.714796 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 08:51:53.714796 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 08:51:53.714796 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 08:51:53.714796 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 08:51:53.715711 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:51:53.715711 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:51:53.715711 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:51:53.715711 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:51:53.715711 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bf70ba33-c808-444c-aa7a-b88f3c7d2fea could not be found. Jun 17 08:51:53.715711 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:51:53.715711 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:51:53.715711 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:51:53.715711 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:51:53.715711 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:51:53.715711 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:51:53.715711 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:51:53.715711 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:51:53.715711 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 08:51:53.715711 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 08:51:53.715711 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:51:53.715711 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:51:53.715711 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 08:51:53.715711 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:51:53.716571 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bf70ba33-c808-444c-aa7a-b88f3c7d2fea could not be found. Jun 17 08:51:53.716571 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:51:53.716571 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:51:53.716571 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:51:53.716571 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:51:53.716571 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:51:53.716571 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:51:53.716571 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:51:53.716571 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:51:53.716571 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bf70ba33-c808-444c-aa7a-b88f3c7d2fea could not be found. Jun 17 08:51:53.716571 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:51:53.722176 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3a039ff9-48ff-4296-a93e-323bd525c6c2 tempest-VolumesGetTestJSON-1245697272 tempest-VolumesGetTestJSON-1245697272-project] Returning 404 to user: Volume bf70ba33-c808-444c-aa7a-b88f3c7d2fea could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:51:53.727844 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-3a039ff9-48ff-4296-a93e-323bd525c6c2 tempest-VolumesGetTestJSON-1245697272 tempest-VolumesGetTestJSON-1245697272-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/bf70ba33-c808-444c-aa7a-b88f3c7d2fea" status: 404 len: 109 microversion: 2.1 time: 0.377448 Jun 17 08:51:53.732793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 10/20] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jun 17 08:51:53 2022] GET /compute/v2.1/os-volumes/bf70ba33-c808-444c-aa7a-b88f3c7d2fea => generated 109 bytes in 383 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:51:53.753930 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-091b0ca6-7f68-472f-82eb-258a21f9a9bb tempest-VolumesTestJSON-2004235675 tempest-VolumesTestJSON-2004235675-project] Calling method '.version_select at 0x7fbc42383af0>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:53.980519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a9994dc3-4e03-4e0a-b0d3-ccae8a8ef3d0 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] 10.222.0.78 "DELETE /compute/v2.1/os-snapshots/17e91f43-2418-4fbd-8ab0-6d6d70662ddd" status: 202 len: 0 microversion: 2.1 time: 0.323838 Jun 17 08:51:53.980519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 11/21] 10.222.0.78 () {58 vars in 1253 bytes} [Fri Jun 17 08:51:53 2022] DELETE /compute/v2.1/os-snapshots/17e91f43-2418-4fbd-8ab0-6d6d70662ddd => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:51:53.988161 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-70231462-ab1d-474f-9042-a819c622a0b5 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Calling method '.version_select at 0x7fbc4195ff70>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:54.049106 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-091b0ca6-7f68-472f-82eb-258a21f9a9bb tempest-VolumesTestJSON-2004235675 tempest-VolumesTestJSON-2004235675-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/b68ff584-1f64-4c64-9f22-b9c0bad6150f" status: 200 len: 350 microversion: 2.1 time: 0.302428 Jun 17 08:51:54.049106 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 11/22] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jun 17 08:51:53 2022] GET /compute/v2.1/os-volumes/b68ff584-1f64-4c64-9f22-b9c0bad6150f => generated 350 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:51:54.071570 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-70231462-ab1d-474f-9042-a819c622a0b5 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/17e91f43-2418-4fbd-8ab0-6d6d70662ddd" status: 200 len: 287 microversion: 2.1 time: 0.087200 Jun 17 08:51:54.072311 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 12/23] 10.222.0.78 () {58 vars in 1250 bytes} [Fri Jun 17 08:51:53 2022] GET /compute/v2.1/os-snapshots/17e91f43-2418-4fbd-8ab0-6d6d70662ddd => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:51:54.078239 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-0ca52105-1968-4d4e-9e7e-4dab025eb8a0 tempest-VolumesTestJSON-2004235675 tempest-VolumesTestJSON-2004235675-project] Calling method '.version_select at 0x7fbc4195f5e0>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:54.138645 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-84cdf7d5-a4f5-40e0-85a0-533915dcf44e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Action: 'create', calling method: .version_select at 0x7fbc419b3f70>, body: {"keypair": {"name": "tempest-keypair-218135140", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3MuprpdkxCrgEhTIlgLo4rGxeWhkuwYzuTIDFo1Hn/VAhbaerTirkdK+Ollxz391tF12kWp1XNdGZsjeEhsX4Z8/3NdN8Fpo2c57CHpT58e7SpPaGrnkdSq8t/bhKV1w=="}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:51:54.214980 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-0ca52105-1968-4d4e-9e7e-4dab025eb8a0 tempest-VolumesTestJSON-2004235675 tempest-VolumesTestJSON-2004235675-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.141485 Jun 17 08:51:54.216419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 13/24] 10.222.0.78 () {58 vars in 1133 bytes} [Fri Jun 17 08:51:54 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:51:54.229501 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-269ff518-5512-42a6-87d2-fb3e12da10a5 tempest-VolumesTestJSON-2004235675 tempest-VolumesTestJSON-2004235675-project] Calling method '.version_select at 0x7fbc4110eb80>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:54.240675 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-84cdf7d5-a4f5-40e0-85a0-533915dcf44e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Getting quotas for project b493dbf75ed64a7dbda3e9c6a6168f8f. Resources: {'key_pairs'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:51:54.248939 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-84cdf7d5-a4f5-40e0-85a0-533915dcf44e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Getting quotas for user b0eb46b0aeeb46fe8dcdb02f29ae4013 and project b493dbf75ed64a7dbda3e9c6a6168f8f. Resources: {'key_pairs'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:51:54.463162 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-269ff518-5512-42a6-87d2-fb3e12da10a5 tempest-VolumesTestJSON-2004235675 tempest-VolumesTestJSON-2004235675-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.238081 Jun 17 08:51:54.470584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 14/25] 10.222.0.78 () {58 vars in 1148 bytes} [Fri Jun 17 08:51:54 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:51:54.477546 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-1b9899d9-9508-4fac-9d42-45ba394f28ef tempest-VolumesTestJSON-2004235675 tempest-VolumesTestJSON-2004235675-project] Calling method '.version_select at 0x7fbc4110e8b0>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:54.493785 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-84cdf7d5-a4f5-40e0-85a0-533915dcf44e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.438019 Jun 17 08:51:54.497160 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 12/26] 10.222.0.78 () {62 vars in 1199 bytes} [Fri Jun 17 08:51:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 440 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 17 08:51:54.674143 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-1b9899d9-9508-4fac-9d42-45ba394f28ef tempest-VolumesTestJSON-2004235675 tempest-VolumesTestJSON-2004235675-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.202114 Jun 17 08:51:54.681839 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 15/27] 10.222.0.78 () {58 vars in 1133 bytes} [Fri Jun 17 08:51:54 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:51:54.691216 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-962dbd3f-fdc1-44ac-8db5-cf18d7878912 tempest-VolumesTestJSON-2004235675 tempest-VolumesTestJSON-2004235675-project] Calling method '.version_select at 0x7fbc418ed670>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:54.849516 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-962dbd3f-fdc1-44ac-8db5-cf18d7878912 tempest-VolumesTestJSON-2004235675 tempest-VolumesTestJSON-2004235675-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.165946 Jun 17 08:51:54.851110 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 13/28] 10.222.0.78 () {58 vars in 1166 bytes} [Fri Jun 17 08:51:54 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:51:54.863814 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-0438e5bd-98b3-441c-a22f-b53805fcb71e tempest-VolumesTestJSON-2004235675 tempest-VolumesTestJSON-2004235675-project] Calling method '.version_select at 0x7fbc423caaf0>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:55.058226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-0438e5bd-98b3-441c-a22f-b53805fcb71e tempest-VolumesTestJSON-2004235675 tempest-VolumesTestJSON-2004235675-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.198977 Jun 17 08:51:55.059087 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 16/29] 10.222.0.78 () {58 vars in 1169 bytes} [Fri Jun 17 08:51:54 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:51:55.077920 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-77fbdc75-5b31-49ff-ab75-7ca3526038f4 tempest-VolumesTestJSON-2004235675 tempest-VolumesTestJSON-2004235675-project] Calling method '.version_select at 0x7fbc418edaf0>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:55.090214 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-6fec5380-6860-4e9d-830c-7d32ecbb8982 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Calling method '.version_select at 0x7fbc4111f280>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:55.164004 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-6fec5380-6860-4e9d-830c-7d32ecbb8982 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/17e91f43-2418-4fbd-8ab0-6d6d70662ddd" status: 200 len: 287 microversion: 2.1 time: 0.079282 Jun 17 08:51:55.165142 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 17/30] 10.222.0.78 () {58 vars in 1250 bytes} [Fri Jun 17 08:51:55 2022] GET /compute/v2.1/os-snapshots/17e91f43-2418-4fbd-8ab0-6d6d70662ddd => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:51:55.299421 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-77fbdc75-5b31-49ff-ab75-7ca3526038f4 tempest-VolumesTestJSON-2004235675 tempest-VolumesTestJSON-2004235675-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.231543 Jun 17 08:51:55.300585 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 14/31] 10.222.0.78 () {58 vars in 1154 bytes} [Fri Jun 17 08:51:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:51:55.313783 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-12099d7c-2360-4ed5-bb4e-0ec6cffaa66b tempest-VolumesTestJSON-2004235675 tempest-VolumesTestJSON-2004235675-project] Calling method '.version_select at 0x7fbc4195fca0>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:55.442167 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-12099d7c-2360-4ed5-bb4e-0ec6cffaa66b tempest-VolumesTestJSON-2004235675 tempest-VolumesTestJSON-2004235675-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.133140 Jun 17 08:51:55.451331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 18/32] 10.222.0.78 () {58 vars in 1187 bytes} [Fri Jun 17 08:51:55 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:51:55.456260 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-273c7083-62d4-4c65-aaa2-5901f25136c4 tempest-VolumesTestJSON-2004235675 tempest-VolumesTestJSON-2004235675-project] Calling method '.version_select at 0x7fbc410a4940>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:55.765049 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-273c7083-62d4-4c65-aaa2-5901f25136c4 tempest-VolumesTestJSON-2004235675 tempest-VolumesTestJSON-2004235675-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.312035 Jun 17 08:51:55.780553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 15/33] 10.222.0.78 () {58 vars in 1154 bytes} [Fri Jun 17 08:51:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:51:55.986052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-60dc5996-5d0a-488b-8ef0-26b08aa22a43 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1577065425", "imageRef": "978084c7-ed2c-4e42-ac8b-f5d19c4001fe", "flavorRef": "452", "networks": [{"uuid": "e2f9f60a-b82f-48c3-9f9e-8ceb37fec40b"}]}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:51:56.130137 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.network.neutron [None req-60dc5996-5d0a-488b-8ef0-26b08aa22a43 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] validate_networks() for [('e2f9f60a-b82f-48c3-9f9e-8ceb37fec40b', None, None, None, None, None)] {{(pid=129876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:51:56.188384 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a7cde2ac-5a4a-40e2-a699-940e63798d55 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Calling method '.version_select at 0x7fbc410b0670>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:56.230155 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-a7cde2ac-5a4a-40e2-a699-940e63798d55 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/17e91f43-2418-4fbd-8ab0-6d6d70662ddd" status: 200 len: 287 microversion: 2.1 time: 0.046202 Jun 17 08:51:56.235121 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 16/34] 10.222.0.78 () {58 vars in 1250 bytes} [Fri Jun 17 08:51:56 2022] GET /compute/v2.1/os-snapshots/17e91f43-2418-4fbd-8ab0-6d6d70662ddd => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:51:57.243013 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-701b7636-8565-451b-99f3-794276ff7613 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Calling method '.version_select at 0x7fbc418ed670>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:57.343962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-701b7636-8565-451b-99f3-794276ff7613 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] HTTP exception thrown: Snapshot 17e91f43-2418-4fbd-8ab0-6d6d70662ddd could not be found. Jun 17 08:51:57.343962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-701b7636-8565-451b-99f3-794276ff7613 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Request method failure captured: Jun 17 08:51:57.343962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: GET /compute/v2.1/os-snapshots/17e91f43-2418-4fbd-8ab0-6d6d70662ddd HTTP/1.1 Jun 17 08:51:57.343962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 08:51:57.343962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 08:51:57.343962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 08:51:57.343962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 08:51:57.343962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 08:51:57.343962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 08:51:57.343962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 08:51:57.343962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 08:51:57.343962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirECdhRbCvxfDcyyrVd-8E7fxD79anj0pA59WrMknWhM_SvqPlqGNVQ_o2RT1Jp89sfJweSlGzp9wMGGG6KpIS5SYbtK4pI-7ckoZYfp7Kr3rsrA6u1aCYVzP05S-EX_q2hm9cokn6-0QHT3RYhwi_Rz757cx9_QoE193a1rlmn6jvdY Jun 17 08:51:57.343962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 08:51:57.343962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 08:51:57.343962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 08:51:57.343962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 08:51:57.343962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 08:51:57.343962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 08:51:57.343962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: e06c8d8aad664fd2a55e9e871bc9842a Jun 17 08:51:57.343962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1495081103 Jun 17 08:51:57.343962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 08:51:57.343962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 08:51:57.345783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e06c8d8aad664fd2a55e9e871bc9842a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e06c8d8aad664fd2a55e9e871bc9842a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e06c8d8aad664fd2a55e9e871bc9842a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e06c8d8aad664fd2a55e9e871bc9842a"}]}] Jun 17 08:51:57.345783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1495081103 Jun 17 08:51:57.345783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: e06c8d8aad664fd2a55e9e871bc9842a Jun 17 08:51:57.345783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1495081103 Jun 17 08:51:57.345783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-VolumesSnapshotsTestJSON-1495081103-project Jun 17 08:51:57.345783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 08:51:57.345783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 08:51:57.345783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: 65143f81d67b4a33b50540d0d6da13fa Jun 17 08:51:57.345783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1495081103-project Jun 17 08:51:57.345783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: Jun 17 08:51:57.345783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Snapshot 17e91f43-2418-4fbd-8ab0-6d6d70662ddd could not be found. Jun 17 08:51:57.345783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'id': '17e91f43-2418-4fbd-8ab0-6d6d70662ddd'} Jun 17 08:51:57.345783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:51:57.346545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:51:57.346545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 17 08:51:57.346545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 17 08:51:57.346545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 17 08:51:57.346545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 17 08:51:57.346545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 17 08:51:57.346545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 17 08:51:57.346545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 08:51:57.346545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 08:51:57.346545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 08:51:57.346545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 08:51:57.346545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:51:57.346545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:51:57.346545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:51:57.346545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:51:57.346545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 17e91f43-2418-4fbd-8ab0-6d6d70662ddd could not be found. (HTTP 404) (Request-ID: req-08651cba-aece-452c-adfa-c2541090a29e) Jun 17 08:51:57.346545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:51:57.346545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:51:57.348081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:51:57.348081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:51:57.348081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 17 08:51:57.348081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 17 08:51:57.348081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 08:51:57.348081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 08:51:57.348081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 17 08:51:57.348081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 17 08:51:57.348081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 08:51:57.348081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 08:51:57.348081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 17 08:51:57.348081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 17 08:51:57.348081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 17 08:51:57.348081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 17 08:51:57.348081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 17 08:51:57.348081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 17 08:51:57.348081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 08:51:57.348081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 08:51:57.348081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 08:51:57.349303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 08:51:57.349303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:51:57.349303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:51:57.349303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:51:57.349303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:51:57.349303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 17e91f43-2418-4fbd-8ab0-6d6d70662ddd could not be found. Jun 17 08:51:57.349303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:51:57.349303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:51:57.349303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:51:57.349303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:51:57.349303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:51:57.349303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:51:57.349303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:51:57.349303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:51:57.349303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 08:51:57.349303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 08:51:57.349303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:51:57.349303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:51:57.349303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 17 08:51:57.349303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:51:57.350483 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 17e91f43-2418-4fbd-8ab0-6d6d70662ddd could not be found. Jun 17 08:51:57.350483 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:51:57.350483 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:51:57.350483 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:51:57.350483 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:51:57.350483 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:51:57.350483 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:51:57.350483 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:51:57.350483 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:51:57.350483 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 17e91f43-2418-4fbd-8ab0-6d6d70662ddd could not be found. Jun 17 08:51:57.350483 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:51:57.350483 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-701b7636-8565-451b-99f3-794276ff7613 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Returning 404 to user: Snapshot 17e91f43-2418-4fbd-8ab0-6d6d70662ddd could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:51:57.350483 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-701b7636-8565-451b-99f3-794276ff7613 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/17e91f43-2418-4fbd-8ab0-6d6d70662ddd" status: 404 len: 111 microversion: 2.1 time: 0.106552 Jun 17 08:51:57.351694 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 17/35] 10.222.0.78 () {58 vars in 1250 bytes} [Fri Jun 17 08:51:57 2022] GET /compute/v2.1/os-snapshots/17e91f43-2418-4fbd-8ab0-6d6d70662ddd => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:51:57.358289 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-bf0b7b6c-fd38-4de0-846a-1e16893341bb tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Calling method '.version_select at 0x7fbc410b0280>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:57.668417 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-bf0b7b6c-fd38-4de0-846a-1e16893341bb tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/89240a88-ac16-4a66-93be-23eb2a69d778" status: 202 len: 0 microversion: 2.1 time: 0.318442 Jun 17 08:51:57.669200 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 18/36] 10.222.0.78 () {58 vars in 1247 bytes} [Fri Jun 17 08:51:57 2022] DELETE /compute/v2.1/os-volumes/89240a88-ac16-4a66-93be-23eb2a69d778 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:51:57.677309 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-4beccd82-125e-45b3-ab2d-83438c82505e tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Calling method '.version_select at 0x7fbc418ede50>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:57.797045 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-4beccd82-125e-45b3-ab2d-83438c82505e tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/89240a88-ac16-4a66-93be-23eb2a69d778" status: 200 len: 344 microversion: 2.1 time: 0.123187 Jun 17 08:51:57.802213 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 19/37] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jun 17 08:51:57 2022] GET /compute/v2.1/os-volumes/89240a88-ac16-4a66-93be-23eb2a69d778 => generated 344 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:51:58.551208 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-60dc5996-5d0a-488b-8ef0-26b08aa22a43 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Flavor limits 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:51:58.551783 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-60dc5996-5d0a-488b-8ef0-26b08aa22a43 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Image limits 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:51:58.552183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-60dc5996-5d0a-488b-8ef0-26b08aa22a43 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Flavor pref 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:51:58.552828 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-60dc5996-5d0a-488b-8ef0-26b08aa22a43 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Image pref 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:51:58.553519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-60dc5996-5d0a-488b-8ef0-26b08aa22a43 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:51:58.584321 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-60dc5996-5d0a-488b-8ef0-26b08aa22a43 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:51:58.597911 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-60dc5996-5d0a-488b-8ef0-26b08aa22a43 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:51:58.599230 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-60dc5996-5d0a-488b-8ef0-26b08aa22a43 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:51:58.602418 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-60dc5996-5d0a-488b-8ef0-26b08aa22a43 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:51:58.666863 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-60dc5996-5d0a-488b-8ef0-26b08aa22a43 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Getting quotas for project 63675a395d824db687bca143dc25c3b2. Resources: {'ram', 'cores', 'instances'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:51:58.678970 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-60dc5996-5d0a-488b-8ef0-26b08aa22a43 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Getting quotas for user 72e4c92b149c4dffbdeba414d8803bf8 and project 63675a395d824db687bca143dc25c3b2. Resources: {'ram', 'cores', 'instances'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:51:58.708153 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-60dc5996-5d0a-488b-8ef0-26b08aa22a43 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Going to run 1 instances... {{(pid=129876) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:51:58.716003 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-60dc5996-5d0a-488b-8ef0-26b08aa22a43 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='978084c7-ed2c-4e42-ac8b-f5d19c4001fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:51:58.810182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1e4a007f-4525-4950-a754-3eedb4e70ea3 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Calling method '.version_select at 0x7fbc410b0310>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:58.931070 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-1e4a007f-4525-4950-a754-3eedb4e70ea3 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/89240a88-ac16-4a66-93be-23eb2a69d778" status: 200 len: 344 microversion: 2.1 time: 0.125151 Jun 17 08:51:58.938295 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 20/38] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jun 17 08:51:58 2022] GET /compute/v2.1/os-volumes/89240a88-ac16-4a66-93be-23eb2a69d778 => generated 344 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:51:59.054626 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-60dc5996-5d0a-488b-8ef0-26b08aa22a43 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.330715 Jun 17 08:51:59.060786 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 19/39] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jun 17 08:51:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 17 08:51:59.072257 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-f6ccbe34-e9a0-411c-9a89-8766a7639a55 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:59.073096 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-f6ccbe34-e9a0-411c-9a89-8766a7639a55 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:51:59.113378 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-37e0557a-bce0-4027-8b8f-059386bf1f3d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-884960164", "imageRef": "978084c7-ed2c-4e42-ac8b-f5d19c4001fe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5af04e5-5681-4034-bf01-a7f9807128a2"}], "security_groups": [{"name": "tempest-securitygroup--1078116533"}], "key_name": "tempest-keypair-1109878213", "user_data": "}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:51:59.781724 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f6ccbe34-e9a0-411c-9a89-8766a7639a55 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:51:59.781724 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-f6ccbe34-e9a0-411c-9a89-8766a7639a55 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1215 microversion: 2.1 time: 0.598756 Jun 17 08:51:59.781724 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 21/40] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:51:59 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1215 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:51:59.789379 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.network.neutron [None req-37e0557a-bce0-4027-8b8f-059386bf1f3d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] validate_networks() for [('b5af04e5-5681-4034-bf01-a7f9807128a2', None, None, None, None, None)] {{(pid=129876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:51:59.946137 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-9e8ae852-b0f8-4237-8887-7b5499a72202 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Calling method '.version_select at 0x7fbc410bbca0>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:00.010600 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-9e8ae852-b0f8-4237-8887-7b5499a72202 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/89240a88-ac16-4a66-93be-23eb2a69d778" status: 200 len: 344 microversion: 2.1 time: 0.068759 Jun 17 08:52:00.022813 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 22/41] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jun 17 08:51:59 2022] GET /compute/v2.1/os-volumes/89240a88-ac16-4a66-93be-23eb2a69d778 => generated 344 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:52:00.484298 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-37e0557a-bce0-4027-8b8f-059386bf1f3d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Flavor limits 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:52:00.484727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-37e0557a-bce0-4027-8b8f-059386bf1f3d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Image limits 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:52:00.485208 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-37e0557a-bce0-4027-8b8f-059386bf1f3d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Flavor pref 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:52:00.485675 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-37e0557a-bce0-4027-8b8f-059386bf1f3d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Image pref 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:52:00.486094 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-37e0557a-bce0-4027-8b8f-059386bf1f3d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:52:00.503411 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-37e0557a-bce0-4027-8b8f-059386bf1f3d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:00.503963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-37e0557a-bce0-4027-8b8f-059386bf1f3d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:00.505180 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-37e0557a-bce0-4027-8b8f-059386bf1f3d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:00.506305 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-37e0557a-bce0-4027-8b8f-059386bf1f3d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:00.561233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-37e0557a-bce0-4027-8b8f-059386bf1f3d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Getting quotas for project 794e7ebcf5c3436081b8e8d39907b655. Resources: {'ram', 'cores', 'instances'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:52:00.576160 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-37e0557a-bce0-4027-8b8f-059386bf1f3d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Getting quotas for user 01bb3df8b4b649388d1a0f6c24e18f1b and project 794e7ebcf5c3436081b8e8d39907b655. Resources: {'ram', 'cores', 'instances'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:52:00.594986 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-37e0557a-bce0-4027-8b8f-059386bf1f3d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Going to run 1 instances... {{(pid=129876) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:52:00.598235 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-37e0557a-bce0-4027-8b8f-059386bf1f3d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='978084c7-ed2c-4e42-ac8b-f5d19c4001fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:52:00.685595 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a1b8974e-8ec5-42b8-afda-d6da05f3a72d tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:00.686439 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-a1b8974e-8ec5-42b8-afda-d6da05f3a72d tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:00.807474 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-37e0557a-bce0-4027-8b8f-059386bf1f3d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.698647 Jun 17 08:52:00.815416 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 20/42] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jun 17 08:51:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 1708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 17 08:52:00.843303 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-7fe78f94-5b21-44fb-affb-5e843abfc53c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:00.847866 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-7fe78f94-5b21-44fb-affb-5e843abfc53c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:00.888561 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a1b8974e-8ec5-42b8-afda-d6da05f3a72d tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:00.895999 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-a1b8974e-8ec5-42b8-afda-d6da05f3a72d tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1215 microversion: 2.1 time: 0.216731 Jun 17 08:52:00.900921 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 23/43] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:00 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1215 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:00.924805 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-84154c20-8ddf-4691-aac6-b1a54741b235 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1833054446", "imageRef": "978084c7-ed2c-4e42-ac8b-f5d19c4001fe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4f7d1d4a-2c54-4698-9b36-243535e9ccac"}], "security_groups": [{"name": "tempest-securitygroup--753909476"}], "key_name": "tempest-keypair-218135140", "user_data": "}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:52:01.047183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-7fe78f94-5b21-44fb-affb-5e843abfc53c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:01.071977 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-7fe78f94-5b21-44fb-affb-5e843abfc53c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1241 microversion: 2.1 time: 0.250515 Jun 17 08:52:01.072567 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 21/44] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:00 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1241 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:01.077178 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-f9d68a55-61ae-4d8d-9500-9131bba795e0 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Calling method '.version_select at 0x7fbc4005d8b0>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:01.135939 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.network.neutron [None req-84154c20-8ddf-4691-aac6-b1a54741b235 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] validate_networks() for [('4f7d1d4a-2c54-4698-9b36-243535e9ccac', None, None, None, None, None)] {{(pid=129875) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:52:01.249232 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-f9d68a55-61ae-4d8d-9500-9131bba795e0 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] HTTP exception thrown: Volume 89240a88-ac16-4a66-93be-23eb2a69d778 could not be found. Jun 17 08:52:01.253821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-f9d68a55-61ae-4d8d-9500-9131bba795e0 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Request method failure captured: Jun 17 08:52:01.253821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: GET /compute/v2.1/os-volumes/89240a88-ac16-4a66-93be-23eb2a69d778 HTTP/1.1 Jun 17 08:52:01.253821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:52:01.253821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:52:01.253821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:52:01.253821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 08:52:01.253821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:52:01.253821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:52:01.253821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:52:01.253821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:52:01.253821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirECdhRbCvxfDcyyrVd-8E7fxD79anj0pA59WrMknWhM_SvqPlqGNVQ_o2RT1Jp89sfJweSlGzp9wMGGG6KpIS5SYbtK4pI-7ckoZYfp7Kr3rsrA6u1aCYVzP05S-EX_q2hm9cokn6-0QHT3RYhwi_Rz757cx9_QoE193a1rlmn6jvdY Jun 17 08:52:01.253821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:52:01.253821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:52:01.253821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:52:01.253821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:52:01.253821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:52:01.253821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:52:01.253821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: e06c8d8aad664fd2a55e9e871bc9842a Jun 17 08:52:01.253821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1495081103 Jun 17 08:52:01.253821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:52:01.253821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:52:01.255122 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e06c8d8aad664fd2a55e9e871bc9842a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e06c8d8aad664fd2a55e9e871bc9842a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e06c8d8aad664fd2a55e9e871bc9842a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e06c8d8aad664fd2a55e9e871bc9842a"}]}] Jun 17 08:52:01.255122 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1495081103 Jun 17 08:52:01.255122 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: e06c8d8aad664fd2a55e9e871bc9842a Jun 17 08:52:01.255122 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1495081103 Jun 17 08:52:01.255122 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-VolumesSnapshotsTestJSON-1495081103-project Jun 17 08:52:01.255122 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:52:01.255122 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:52:01.255122 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: 65143f81d67b4a33b50540d0d6da13fa Jun 17 08:52:01.255122 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1495081103-project Jun 17 08:52:01.255122 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: Jun 17 08:52:01.255122 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Volume 89240a88-ac16-4a66-93be-23eb2a69d778 could not be found. Jun 17 08:52:01.255122 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'id': '89240a88-ac16-4a66-93be-23eb2a69d778'} Jun 17 08:52:01.255122 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:52:01.255847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:01.255847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:52:01.255847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:52:01.255847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 08:52:01.255847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 08:52:01.255847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 08:52:01.255847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 08:52:01.255847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 08:52:01.255847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 08:52:01.255847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 08:52:01.255847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 08:52:01.255847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:52:01.255847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:52:01.255847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:52:01.255847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:52:01.255847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 89240a88-ac16-4a66-93be-23eb2a69d778 could not be found. (HTTP 404) (Request-ID: req-998c0ecf-6b05-4651-88da-8ca05122f174) Jun 17 08:52:01.255847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.255847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:01.255847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.259092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:01.259092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 08:52:01.259092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 08:52:01.259092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 08:52:01.259092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 08:52:01.259092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 08:52:01.259092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 08:52:01.259092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 08:52:01.259092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 08:52:01.259092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:52:01.259092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:52:01.259092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 08:52:01.259092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 08:52:01.259092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 08:52:01.259092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 08:52:01.259092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 08:52:01.259092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 08:52:01.259092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 08:52:01.259092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 08:52:01.261301 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:52:01.261301 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:52:01.261301 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:52:01.261301 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:52:01.261301 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 89240a88-ac16-4a66-93be-23eb2a69d778 could not be found. Jun 17 08:52:01.261301 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.261301 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:01.261301 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.261301 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:01.261301 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:01.261301 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:01.261301 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:52:01.261301 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:52:01.261301 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 08:52:01.261301 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 08:52:01.261301 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:52:01.261301 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:52:01.261301 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 08:52:01.261301 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:52:01.263443 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 89240a88-ac16-4a66-93be-23eb2a69d778 could not be found. Jun 17 08:52:01.263443 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.263443 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:01.263443 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.263443 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:01.263443 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:01.263443 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:01.263443 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:52:01.263443 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:52:01.263443 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 89240a88-ac16-4a66-93be-23eb2a69d778 could not be found. Jun 17 08:52:01.263443 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.263443 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-f9d68a55-61ae-4d8d-9500-9131bba795e0 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Returning 404 to user: Volume 89240a88-ac16-4a66-93be-23eb2a69d778 could not be found. {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:52:01.263443 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-f9d68a55-61ae-4d8d-9500-9131bba795e0 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/89240a88-ac16-4a66-93be-23eb2a69d778" status: 404 len: 109 microversion: 2.1 time: 0.181865 Jun 17 08:52:01.263443 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 22/45] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jun 17 08:52:01 2022] GET /compute/v2.1/os-volumes/89240a88-ac16-4a66-93be-23eb2a69d778 => generated 109 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:52:01.269638 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-2c4ac4cf-d9ff-4d4c-bce6-71bcfd1eb6e4 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Calling method '.version_select at 0x7fbc33fc04c0>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:01.373731 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-2c4ac4cf-d9ff-4d4c-bce6-71bcfd1eb6e4 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] HTTP exception thrown: Volume 89240a88-ac16-4a66-93be-23eb2a69d778 could not be found. Jun 17 08:52:01.376062 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-2c4ac4cf-d9ff-4d4c-bce6-71bcfd1eb6e4 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Request method failure captured: Jun 17 08:52:01.376062 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: DELETE /compute/v2.1/os-volumes/89240a88-ac16-4a66-93be-23eb2a69d778 HTTP/1.1 Jun 17 08:52:01.376062 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:52:01.376062 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:52:01.376062 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:52:01.376062 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 08:52:01.376062 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:52:01.376062 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:52:01.376062 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:52:01.376062 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:52:01.376062 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirECdhRbCvxfDcyyrVd-8E7fxD79anj0pA59WrMknWhM_SvqPlqGNVQ_o2RT1Jp89sfJweSlGzp9wMGGG6KpIS5SYbtK4pI-7ckoZYfp7Kr3rsrA6u1aCYVzP05S-EX_q2hm9cokn6-0QHT3RYhwi_Rz757cx9_QoE193a1rlmn6jvdY Jun 17 08:52:01.376062 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:52:01.376062 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:52:01.376062 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:52:01.376062 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:52:01.376062 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:52:01.376062 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:52:01.376062 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: e06c8d8aad664fd2a55e9e871bc9842a Jun 17 08:52:01.376062 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1495081103 Jun 17 08:52:01.376062 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:52:01.376062 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:52:01.377160 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e06c8d8aad664fd2a55e9e871bc9842a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e06c8d8aad664fd2a55e9e871bc9842a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e06c8d8aad664fd2a55e9e871bc9842a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e06c8d8aad664fd2a55e9e871bc9842a"}]}] Jun 17 08:52:01.377160 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1495081103 Jun 17 08:52:01.377160 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: e06c8d8aad664fd2a55e9e871bc9842a Jun 17 08:52:01.377160 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1495081103 Jun 17 08:52:01.377160 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-VolumesSnapshotsTestJSON-1495081103-project Jun 17 08:52:01.377160 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:52:01.377160 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:52:01.377160 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: 65143f81d67b4a33b50540d0d6da13fa Jun 17 08:52:01.377160 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1495081103-project Jun 17 08:52:01.377160 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: Jun 17 08:52:01.377160 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Volume 89240a88-ac16-4a66-93be-23eb2a69d778 could not be found. Jun 17 08:52:01.377160 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'id': '89240a88-ac16-4a66-93be-23eb2a69d778'} Jun 17 08:52:01.377160 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:52:01.377840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:01.377840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:52:01.377840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:52:01.377840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 08:52:01.377840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 08:52:01.377840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 08:52:01.377840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 08:52:01.377840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 08:52:01.377840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 08:52:01.377840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 08:52:01.377840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 08:52:01.377840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:52:01.377840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:52:01.377840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:52:01.377840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:52:01.377840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 89240a88-ac16-4a66-93be-23eb2a69d778 could not be found. (HTTP 404) (Request-ID: req-8ea53133-b8da-409e-a779-f024318954c8) Jun 17 08:52:01.377840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.377840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:01.377840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.379577 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:01.379577 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 17 08:52:01.379577 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 17 08:52:01.379577 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 08:52:01.379577 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 08:52:01.379577 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 08:52:01.379577 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 08:52:01.379577 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 08:52:01.379577 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 08:52:01.379577 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:52:01.379577 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:52:01.379577 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 08:52:01.379577 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 08:52:01.379577 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 08:52:01.379577 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 08:52:01.379577 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 08:52:01.379577 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 08:52:01.379577 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 08:52:01.379577 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 08:52:01.380727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:52:01.380727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:52:01.380727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:52:01.380727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:52:01.380727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 89240a88-ac16-4a66-93be-23eb2a69d778 could not be found. Jun 17 08:52:01.380727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.380727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:01.380727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.380727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:01.380727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:01.380727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:01.380727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:52:01.380727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:52:01.380727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 08:52:01.380727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 08:52:01.380727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:52:01.380727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:52:01.380727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 17 08:52:01.380727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:52:01.388296 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 89240a88-ac16-4a66-93be-23eb2a69d778 could not be found. Jun 17 08:52:01.388296 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.388296 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:01.388296 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.388296 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:01.388296 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:01.388296 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:01.388296 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:52:01.388296 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:52:01.388296 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 89240a88-ac16-4a66-93be-23eb2a69d778 could not be found. Jun 17 08:52:01.388296 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.388296 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-2c4ac4cf-d9ff-4d4c-bce6-71bcfd1eb6e4 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Returning 404 to user: Volume 89240a88-ac16-4a66-93be-23eb2a69d778 could not be found. {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:52:01.388296 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-2c4ac4cf-d9ff-4d4c-bce6-71bcfd1eb6e4 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/89240a88-ac16-4a66-93be-23eb2a69d778" status: 404 len: 109 microversion: 2.1 time: 0.114617 Jun 17 08:52:01.388296 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 23/46] 10.222.0.78 () {58 vars in 1247 bytes} [Fri Jun 17 08:52:01 2022] DELETE /compute/v2.1/os-volumes/89240a88-ac16-4a66-93be-23eb2a69d778 => generated 109 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:52:01.389190 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-60a81ee4-2383-4a3e-9f01-b31801d299f1 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Calling method '.version_select at 0x7fbc33fc0040>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:01.439768 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-60a81ee4-2383-4a3e-9f01-b31801d299f1 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] HTTP exception thrown: Volume 89240a88-ac16-4a66-93be-23eb2a69d778 could not be found. Jun 17 08:52:01.442025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-60a81ee4-2383-4a3e-9f01-b31801d299f1 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Request method failure captured: Jun 17 08:52:01.442025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: GET /compute/v2.1/os-volumes/89240a88-ac16-4a66-93be-23eb2a69d778 HTTP/1.1 Jun 17 08:52:01.442025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:52:01.442025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:52:01.442025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:52:01.442025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 08:52:01.442025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:52:01.442025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:52:01.442025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:52:01.442025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:52:01.442025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirECdhRbCvxfDcyyrVd-8E7fxD79anj0pA59WrMknWhM_SvqPlqGNVQ_o2RT1Jp89sfJweSlGzp9wMGGG6KpIS5SYbtK4pI-7ckoZYfp7Kr3rsrA6u1aCYVzP05S-EX_q2hm9cokn6-0QHT3RYhwi_Rz757cx9_QoE193a1rlmn6jvdY Jun 17 08:52:01.442025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:52:01.442025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:52:01.442025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:52:01.442025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:52:01.442025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:52:01.442025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:52:01.442025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: e06c8d8aad664fd2a55e9e871bc9842a Jun 17 08:52:01.442025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1495081103 Jun 17 08:52:01.442025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:52:01.442025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:52:01.443129 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e06c8d8aad664fd2a55e9e871bc9842a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e06c8d8aad664fd2a55e9e871bc9842a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e06c8d8aad664fd2a55e9e871bc9842a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e06c8d8aad664fd2a55e9e871bc9842a"}]}] Jun 17 08:52:01.443129 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1495081103 Jun 17 08:52:01.443129 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: e06c8d8aad664fd2a55e9e871bc9842a Jun 17 08:52:01.443129 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1495081103 Jun 17 08:52:01.443129 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-VolumesSnapshotsTestJSON-1495081103-project Jun 17 08:52:01.443129 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:52:01.443129 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:52:01.443129 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: 65143f81d67b4a33b50540d0d6da13fa Jun 17 08:52:01.443129 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1495081103-project Jun 17 08:52:01.443129 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: Jun 17 08:52:01.443129 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Volume 89240a88-ac16-4a66-93be-23eb2a69d778 could not be found. Jun 17 08:52:01.443129 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'id': '89240a88-ac16-4a66-93be-23eb2a69d778'} Jun 17 08:52:01.443129 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:52:01.444409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:01.444409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:52:01.444409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:52:01.444409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 08:52:01.444409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 08:52:01.444409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 08:52:01.444409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 08:52:01.444409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 08:52:01.444409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 08:52:01.444409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 08:52:01.444409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 08:52:01.444409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:52:01.444409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:52:01.444409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:52:01.444409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:52:01.444409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 89240a88-ac16-4a66-93be-23eb2a69d778 could not be found. (HTTP 404) (Request-ID: req-8f71173f-fe11-4c3d-854f-4bd7407f3f11) Jun 17 08:52:01.444409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.444409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:01.444409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.445344 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:01.445344 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 08:52:01.445344 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 08:52:01.445344 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 08:52:01.445344 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 08:52:01.445344 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 08:52:01.445344 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 08:52:01.445344 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 08:52:01.445344 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 08:52:01.445344 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:52:01.445344 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:52:01.445344 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 08:52:01.445344 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 08:52:01.445344 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 08:52:01.445344 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 08:52:01.445344 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 08:52:01.445344 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 08:52:01.445344 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 08:52:01.445344 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 08:52:01.446250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:52:01.446250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:52:01.446250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:52:01.446250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:52:01.446250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 89240a88-ac16-4a66-93be-23eb2a69d778 could not be found. Jun 17 08:52:01.446250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.446250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:01.446250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.446250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:01.446250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:01.446250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:01.446250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:52:01.446250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:52:01.446250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 08:52:01.446250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 08:52:01.446250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:52:01.446250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:52:01.446250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 08:52:01.446250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:52:01.448779 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 89240a88-ac16-4a66-93be-23eb2a69d778 could not be found. Jun 17 08:52:01.448779 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.448779 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:01.448779 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.448779 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:01.448779 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:01.448779 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:01.448779 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:52:01.448779 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:52:01.448779 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 89240a88-ac16-4a66-93be-23eb2a69d778 could not be found. Jun 17 08:52:01.448779 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.451830 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-60a81ee4-2383-4a3e-9f01-b31801d299f1 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] Returning 404 to user: Volume 89240a88-ac16-4a66-93be-23eb2a69d778 could not be found. {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:52:01.457282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-60a81ee4-2383-4a3e-9f01-b31801d299f1 tempest-VolumesSnapshotsTestJSON-1495081103 tempest-VolumesSnapshotsTestJSON-1495081103-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/89240a88-ac16-4a66-93be-23eb2a69d778" status: 404 len: 109 microversion: 2.1 time: 0.069617 Jun 17 08:52:01.457944 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 24/47] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jun 17 08:52:01 2022] GET /compute/v2.1/os-volumes/89240a88-ac16-4a66-93be-23eb2a69d778 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:52:01.918505 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-0876aaef-2b55-4577-89c1-165c5744564b tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:01.919133 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-0876aaef-2b55-4577-89c1-165c5744564b tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:01.937809 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0876aaef-2b55-4577-89c1-165c5744564b tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:01.938267 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0876aaef-2b55-4577-89c1-165c5744564b tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:01.939047 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0876aaef-2b55-4577-89c1-165c5744564b tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:01.939762 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0876aaef-2b55-4577-89c1-165c5744564b tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:02.143674 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-0876aaef-2b55-4577-89c1-165c5744564b tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:02.169181 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-0876aaef-2b55-4577-89c1-165c5744564b tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1219 microversion: 2.1 time: 0.254600 Jun 17 08:52:02.169787 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 25/48] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:01 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1219 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:02.193512 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-49f41f2c-7057-405a-a1d7-0b7990002bad tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:02.195225 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-49f41f2c-7057-405a-a1d7-0b7990002bad tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:02.336376 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-49f41f2c-7057-405a-a1d7-0b7990002bad tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:02.351480 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-49f41f2c-7057-405a-a1d7-0b7990002bad tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1241 microversion: 2.1 time: 0.164798 Jun 17 08:52:02.352782 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 26/49] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:02 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1241 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:02.648385 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-84154c20-8ddf-4691-aac6-b1a54741b235 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Flavor limits 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:52:02.648944 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-84154c20-8ddf-4691-aac6-b1a54741b235 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Image limits 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:52:02.649312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-84154c20-8ddf-4691-aac6-b1a54741b235 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Flavor pref 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:52:02.649733 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-84154c20-8ddf-4691-aac6-b1a54741b235 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Image pref 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:52:02.650153 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-84154c20-8ddf-4691-aac6-b1a54741b235 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:52:02.661057 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-84154c20-8ddf-4691-aac6-b1a54741b235 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:02.661705 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-84154c20-8ddf-4691-aac6-b1a54741b235 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:02.662780 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-84154c20-8ddf-4691-aac6-b1a54741b235 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:02.663461 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-84154c20-8ddf-4691-aac6-b1a54741b235 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:02.717847 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-84154c20-8ddf-4691-aac6-b1a54741b235 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Getting quotas for project b493dbf75ed64a7dbda3e9c6a6168f8f. Resources: {'ram', 'cores', 'instances'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:52:02.722963 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-84154c20-8ddf-4691-aac6-b1a54741b235 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Getting quotas for user b0eb46b0aeeb46fe8dcdb02f29ae4013 and project b493dbf75ed64a7dbda3e9c6a6168f8f. Resources: {'ram', 'cores', 'instances'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:52:02.748943 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-84154c20-8ddf-4691-aac6-b1a54741b235 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Going to run 1 instances... {{(pid=129875) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:52:02.752052 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-84154c20-8ddf-4691-aac6-b1a54741b235 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='978084c7-ed2c-4e42-ac8b-f5d19c4001fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:52:02.989120 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-84154c20-8ddf-4691-aac6-b1a54741b235 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.086989 Jun 17 08:52:02.991843 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 24/50] 10.222.0.78 () {62 vars in 1187 bytes} [Fri Jun 17 08:52:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 2090 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 17 08:52:03.002201 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-8dce8eaa-fcac-4e74-adf9-170a1ca0ac7c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:03.002826 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-8dce8eaa-fcac-4e74-adf9-170a1ca0ac7c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:03.123062 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-8dce8eaa-fcac-4e74-adf9-170a1ca0ac7c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:03.130590 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-8dce8eaa-fcac-4e74-adf9-170a1ca0ac7c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:03.132602 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-8dce8eaa-fcac-4e74-adf9-170a1ca0ac7c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:03.133752 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-8dce8eaa-fcac-4e74-adf9-170a1ca0ac7c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1281 microversion: 2.20 time: 0.135457 Jun 17 08:52:03.140214 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 27/51] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:02 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1281 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:52:03.200420 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-f67bacb3-da12-47a5-a048-c475fcb82a5f tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:03.207229 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-f67bacb3-da12-47a5-a048-c475fcb82a5f tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:03.261699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f67bacb3-da12-47a5-a048-c475fcb82a5f tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:03.262175 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f67bacb3-da12-47a5-a048-c475fcb82a5f tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:03.266497 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f67bacb3-da12-47a5-a048-c475fcb82a5f tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:03.267095 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f67bacb3-da12-47a5-a048-c475fcb82a5f tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:03.373999 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-2fa6aa7e-26de-4054-8772-fbf083edcb4e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:03.375304 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-2fa6aa7e-26de-4054-8772-fbf083edcb4e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:03.397671 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2fa6aa7e-26de-4054-8772-fbf083edcb4e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:03.398734 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2fa6aa7e-26de-4054-8772-fbf083edcb4e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:03.400209 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2fa6aa7e-26de-4054-8772-fbf083edcb4e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:03.400893 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2fa6aa7e-26de-4054-8772-fbf083edcb4e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:03.832888 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f67bacb3-da12-47a5-a048-c475fcb82a5f tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:03.869290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-f67bacb3-da12-47a5-a048-c475fcb82a5f tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1211 microversion: 2.1 time: 0.682361 Jun 17 08:52:03.871808 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 25/52] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:03 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1211 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:03.894350 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-2fa6aa7e-26de-4054-8772-fbf083edcb4e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:03.903105 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-2fa6aa7e-26de-4054-8772-fbf083edcb4e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1245 microversion: 2.1 time: 0.537420 Jun 17 08:52:03.908921 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 28/53] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:03 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1245 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:04.157785 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d6829dbe-0e7e-4324-932e-dfca06b7b346 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:04.158494 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-d6829dbe-0e7e-4324-932e-dfca06b7b346 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:04.241446 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d6829dbe-0e7e-4324-932e-dfca06b7b346 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:04.267473 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d6829dbe-0e7e-4324-932e-dfca06b7b346 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:04.274205 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d6829dbe-0e7e-4324-932e-dfca06b7b346 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:04.279869 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-d6829dbe-0e7e-4324-932e-dfca06b7b346 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1281 microversion: 2.20 time: 0.124748 Jun 17 08:52:04.295336 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 26/54] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:04 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1281 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:52:04.891826 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-815d020b-497d-4ec7-81b7-03eb3f6d5f5f tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:04.892340 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-815d020b-497d-4ec7-81b7-03eb3f6d5f5f tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:04.903700 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-815d020b-497d-4ec7-81b7-03eb3f6d5f5f tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:04.904353 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-815d020b-497d-4ec7-81b7-03eb3f6d5f5f tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:04.906620 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-815d020b-497d-4ec7-81b7-03eb3f6d5f5f tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:04.908962 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-815d020b-497d-4ec7-81b7-03eb3f6d5f5f tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:04.921545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-7dcc467d-73ad-45c1-a705-8db16f2fb9c2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:04.922288 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-7dcc467d-73ad-45c1-a705-8db16f2fb9c2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:04.932320 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7dcc467d-73ad-45c1-a705-8db16f2fb9c2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:04.935686 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7dcc467d-73ad-45c1-a705-8db16f2fb9c2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:04.937852 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7dcc467d-73ad-45c1-a705-8db16f2fb9c2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:04.939381 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7dcc467d-73ad-45c1-a705-8db16f2fb9c2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:05.064768 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-7dcc467d-73ad-45c1-a705-8db16f2fb9c2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:05.074343 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-7dcc467d-73ad-45c1-a705-8db16f2fb9c2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1293 microversion: 2.1 time: 0.156843 Jun 17 08:52:05.075421 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 27/55] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:04 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1293 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:05.262347 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-815d020b-497d-4ec7-81b7-03eb3f6d5f5f tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:05.289433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-815d020b-497d-4ec7-81b7-03eb3f6d5f5f tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1275 microversion: 2.1 time: 0.400070 Jun 17 08:52:05.292447 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 29/56] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:04 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1275 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:05.309288 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-ed38a5b1-46b0-40bb-a058-048878c21247 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:05.310141 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-ed38a5b1-46b0-40bb-a058-048878c21247 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:05.317329 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ed38a5b1-46b0-40bb-a058-048878c21247 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:05.317947 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ed38a5b1-46b0-40bb-a058-048878c21247 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:05.319034 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ed38a5b1-46b0-40bb-a058-048878c21247 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:05.319908 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ed38a5b1-46b0-40bb-a058-048878c21247 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:05.469078 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-ed38a5b1-46b0-40bb-a058-048878c21247 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:05.485577 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-ed38a5b1-46b0-40bb-a058-048878c21247 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:05.493330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-ed38a5b1-46b0-40bb-a058-048878c21247 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:05.497210 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-ed38a5b1-46b0-40bb-a058-048878c21247 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1285 microversion: 2.20 time: 0.192205 Jun 17 08:52:05.497802 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 28/57] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:05 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1285 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:52:05.763279 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-0778881d-52d0-44fa-b1ff-fad57b59a686 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] Action: 'create', calling method: .version_select at 0x7fbc33fc05e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1889362738", "metadata": {"Type": "work"}}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:52:05.789027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-0778881d-52d0-44fa-b1ff-fad57b59a686 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] Request method failure captured: Jun 17 08:52:05.789027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 17 08:52:05.789027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:52:05.789027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:52:05.789027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:52:05.789027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 122 Jun 17 08:52:05.789027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:52:05.789027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:52:05.789027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:52:05.789027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:52:05.789027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirEC1wAxyciYdZ9dryssNLHUl-KsKTim5U-7kXE_2BJ2YSBYb_oG_YCUCr_FXn-BtSqAEF1zfw4Up-_4kgbzTAd_ZmDs3ogaSjNjqnrYTi2mKAeBWiKu6dsCGTO6Pr3AgIXqhm3CQ6XBSenB91yoKcbyTk2Bw1aTYT5tLXnWg7UZSHKs Jun 17 08:52:05.789027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:52:05.789027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:52:05.789027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:52:05.789027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:52:05.789027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:52:05.789027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:52:05.789027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: b131c0701a0843f193e9a876b03a730c Jun 17 08:52:05.789027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-VolumesNegativeTest-1748467710 Jun 17 08:52:05.789027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:52:05.789027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:52:05.798796 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b131c0701a0843f193e9a876b03a730c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b131c0701a0843f193e9a876b03a730c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b131c0701a0843f193e9a876b03a730c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b131c0701a0843f193e9a876b03a730c"}]}] Jun 17 08:52:05.798796 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-VolumesNegativeTest-1748467710 Jun 17 08:52:05.798796 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: b131c0701a0843f193e9a876b03a730c Jun 17 08:52:05.798796 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-VolumesNegativeTest-1748467710 Jun 17 08:52:05.798796 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-VolumesNegativeTest-1748467710-project Jun 17 08:52:05.798796 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:52:05.798796 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:52:05.798796 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: 5d745e4dd1b742f7a7e1255bb4ffd664 Jun 17 08:52:05.798796 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-VolumesNegativeTest-1748467710-project Jun 17 08:52:05.798796 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Jun 17 08:52:05.798796 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1889362738", "metadata": {"Type": "work"}}} Jun 17 08:52:05.798796 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: Jun 17 08:52:05.798796 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 17 08:52:05.799596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1889362738', 'metadata': {'Type': 'work'}}}} Jun 17 08:52:05.799596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:52:05.799596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:05.799596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 17 08:52:05.799596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 17 08:52:05.799596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 17 08:52:05.799596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise error Jun 17 08:52:05.799596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 17 08:52:05.799596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.799596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 17 08:52:05.799596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 17 08:52:05.799596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.799596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 17 08:52:05.799596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi '#$%' Jun 17 08:52:05.799596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.799596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:05.799596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.799596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:05.799596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:05.799596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:05.799596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:52:05.799596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:52:05.800684 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 08:52:05.800684 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 08:52:05.800684 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:52:05.800684 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:52:05.800684 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 17 08:52:05.800684 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 17 08:52:05.800684 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 17 08:52:05.800684 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 17 08:52:05.800684 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 17 08:52:05.800684 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 17 08:52:05.800684 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 17 08:52:05.800684 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.800684 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:05.800684 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.800684 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:05.800684 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:05.800684 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:05.800684 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 17 08:52:05.800684 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 17 08:52:05.801621 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 17 08:52:05.801621 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.801621 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-0778881d-52d0-44fa-b1ff-fad57b59a686 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:52:05.801621 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-0778881d-52d0-44fa-b1ff-fad57b59a686 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.357567 Jun 17 08:52:05.801621 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 30/58] 10.222.0.78 () {60 vars in 1155 bytes} [Fri Jun 17 08:52:05 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 359 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 17 08:52:05.802865 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-07d656e5-4fe0-46fa-888e-04ef197c7a38 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] Action: 'create', calling method: .version_select at 0x7fbc4072ddc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-78536463", "metadata": {"Type": "work"}}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:52:05.809313 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-07d656e5-4fe0-46fa-888e-04ef197c7a38 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] Request method failure captured: Jun 17 08:52:05.809313 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 17 08:52:05.809313 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 08:52:05.809313 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 08:52:05.809313 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 08:52:05.809313 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 118 Jun 17 08:52:05.809313 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 08:52:05.809313 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 08:52:05.809313 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 08:52:05.809313 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 08:52:05.809313 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirEC1wAxyciYdZ9dryssNLHUl-KsKTim5U-7kXE_2BJ2YSBYb_oG_YCUCr_FXn-BtSqAEF1zfw4Up-_4kgbzTAd_ZmDs3ogaSjNjqnrYTi2mKAeBWiKu6dsCGTO6Pr3AgIXqhm3CQ6XBSenB91yoKcbyTk2Bw1aTYT5tLXnWg7UZSHKs Jun 17 08:52:05.809313 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 08:52:05.809313 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 08:52:05.809313 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 08:52:05.809313 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 08:52:05.809313 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 08:52:05.809313 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 08:52:05.809313 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: b131c0701a0843f193e9a876b03a730c Jun 17 08:52:05.809313 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-VolumesNegativeTest-1748467710 Jun 17 08:52:05.809313 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 08:52:05.809313 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 08:52:05.810649 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b131c0701a0843f193e9a876b03a730c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b131c0701a0843f193e9a876b03a730c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b131c0701a0843f193e9a876b03a730c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b131c0701a0843f193e9a876b03a730c"}]}] Jun 17 08:52:05.810649 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-VolumesNegativeTest-1748467710 Jun 17 08:52:05.810649 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: b131c0701a0843f193e9a876b03a730c Jun 17 08:52:05.810649 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-VolumesNegativeTest-1748467710 Jun 17 08:52:05.810649 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-VolumesNegativeTest-1748467710-project Jun 17 08:52:05.810649 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 08:52:05.810649 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 08:52:05.810649 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: 5d745e4dd1b742f7a7e1255bb4ffd664 Jun 17 08:52:05.810649 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-VolumesNegativeTest-1748467710-project Jun 17 08:52:05.810649 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Jun 17 08:52:05.810649 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-78536463", "metadata": {"Type": "work"}}} Jun 17 08:52:05.810649 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: Jun 17 08:52:05.810649 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 17 08:52:05.811797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-78536463', 'metadata': {'Type': 'work'}}}} Jun 17 08:52:05.811797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:52:05.811797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:05.811797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 17 08:52:05.811797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 17 08:52:05.811797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 17 08:52:05.811797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise error Jun 17 08:52:05.811797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 17 08:52:05.811797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.811797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 17 08:52:05.811797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 17 08:52:05.811797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.811797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 17 08:52:05.811797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi '0' Jun 17 08:52:05.811797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.811797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:05.811797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.811797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:05.811797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:05.811797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:05.811797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:52:05.811797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:52:05.812917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 08:52:05.812917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 08:52:05.812917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:52:05.812917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:52:05.812917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 17 08:52:05.812917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 17 08:52:05.812917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 17 08:52:05.812917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 17 08:52:05.812917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 17 08:52:05.812917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 17 08:52:05.812917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 17 08:52:05.812917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.812917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:05.812917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.812917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:05.812917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:05.812917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:05.812917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 17 08:52:05.812917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 17 08:52:05.813863 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 17 08:52:05.813863 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.813863 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-07d656e5-4fe0-46fa-888e-04ef197c7a38 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:52:05.813863 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-07d656e5-4fe0-46fa-888e-04ef197c7a38 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014717 Jun 17 08:52:05.813863 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 29/59] 10.222.0.78 () {60 vars in 1155 bytes} [Fri Jun 17 08:52:05 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 08:52:05.824478 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-ff2281b1-b395-43a7-b1d0-d5df5342d480 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] Action: 'create', calling method: .version_select at 0x7fbc33f0c9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1443057368", "metadata": {"Type": "work"}}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:52:05.827637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-ff2281b1-b395-43a7-b1d0-d5df5342d480 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] Request method failure captured: Jun 17 08:52:05.827637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 17 08:52:05.827637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:52:05.827637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:52:05.827637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:52:05.827637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 119 Jun 17 08:52:05.827637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:52:05.827637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:52:05.827637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:52:05.827637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:52:05.827637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirEC1wAxyciYdZ9dryssNLHUl-KsKTim5U-7kXE_2BJ2YSBYb_oG_YCUCr_FXn-BtSqAEF1zfw4Up-_4kgbzTAd_ZmDs3ogaSjNjqnrYTi2mKAeBWiKu6dsCGTO6Pr3AgIXqhm3CQ6XBSenB91yoKcbyTk2Bw1aTYT5tLXnWg7UZSHKs Jun 17 08:52:05.827637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:52:05.827637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:52:05.827637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:52:05.827637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:52:05.827637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:52:05.827637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:52:05.827637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: b131c0701a0843f193e9a876b03a730c Jun 17 08:52:05.827637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-VolumesNegativeTest-1748467710 Jun 17 08:52:05.827637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:52:05.827637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:52:05.828774 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b131c0701a0843f193e9a876b03a730c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b131c0701a0843f193e9a876b03a730c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b131c0701a0843f193e9a876b03a730c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b131c0701a0843f193e9a876b03a730c"}]}] Jun 17 08:52:05.828774 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-VolumesNegativeTest-1748467710 Jun 17 08:52:05.828774 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: b131c0701a0843f193e9a876b03a730c Jun 17 08:52:05.828774 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-VolumesNegativeTest-1748467710 Jun 17 08:52:05.828774 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-VolumesNegativeTest-1748467710-project Jun 17 08:52:05.828774 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:52:05.828774 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:52:05.828774 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: 5d745e4dd1b742f7a7e1255bb4ffd664 Jun 17 08:52:05.828774 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-VolumesNegativeTest-1748467710-project Jun 17 08:52:05.828774 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Jun 17 08:52:05.828774 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1443057368", "metadata": {"Type": "work"}}} Jun 17 08:52:05.828774 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: Jun 17 08:52:05.828774 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 17 08:52:05.829420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1443057368', 'metadata': {'Type': 'work'}}}} Jun 17 08:52:05.829420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:52:05.829420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:05.829420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 17 08:52:05.829420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 17 08:52:05.829420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 17 08:52:05.829420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise error Jun 17 08:52:05.829420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 17 08:52:05.829420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.829420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 17 08:52:05.829420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 17 08:52:05.829420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.829420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 17 08:52:05.829420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi '' Jun 17 08:52:05.829420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.829420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:05.829420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.829420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:05.829420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:05.829420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:05.829420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:52:05.829420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:52:05.840542 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 08:52:05.840542 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 08:52:05.840542 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:52:05.840542 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:52:05.840542 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 17 08:52:05.840542 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 17 08:52:05.840542 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 17 08:52:05.840542 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 17 08:52:05.840542 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 17 08:52:05.840542 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 17 08:52:05.840542 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 17 08:52:05.840542 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.840542 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:05.840542 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.840542 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:05.840542 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:05.840542 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:05.840542 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 17 08:52:05.840542 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 17 08:52:05.841546 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 17 08:52:05.841546 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.841546 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-ff2281b1-b395-43a7-b1d0-d5df5342d480 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:52:05.841546 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-ff2281b1-b395-43a7-b1d0-d5df5342d480 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011214 Jun 17 08:52:05.841546 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 31/60] 10.222.0.78 () {60 vars in 1155 bytes} [Fri Jun 17 08:52:05 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 08:52:05.846361 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-7fabb4b1-aadf-4d40-bdf1-923430ad2da8 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] Calling method '.version_select at 0x7fbc40749a60>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:05.878621 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-7fabb4b1-aadf-4d40-bdf1-923430ad2da8 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] HTTP exception thrown: Volume tempest-invalid-358722190 could not be found. Jun 17 08:52:05.881457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-7fabb4b1-aadf-4d40-bdf1-923430ad2da8 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] Request method failure captured: Jun 17 08:52:05.881457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-358722190 HTTP/1.1 Jun 17 08:52:05.881457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 08:52:05.881457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 08:52:05.881457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 08:52:05.881457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 08:52:05.881457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 08:52:05.881457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 08:52:05.881457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 08:52:05.881457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 08:52:05.881457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirEC1wAxyciYdZ9dryssNLHUl-KsKTim5U-7kXE_2BJ2YSBYb_oG_YCUCr_FXn-BtSqAEF1zfw4Up-_4kgbzTAd_ZmDs3ogaSjNjqnrYTi2mKAeBWiKu6dsCGTO6Pr3AgIXqhm3CQ6XBSenB91yoKcbyTk2Bw1aTYT5tLXnWg7UZSHKs Jun 17 08:52:05.881457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 08:52:05.881457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 08:52:05.881457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 08:52:05.881457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 08:52:05.881457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 08:52:05.881457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 08:52:05.881457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: b131c0701a0843f193e9a876b03a730c Jun 17 08:52:05.881457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-VolumesNegativeTest-1748467710 Jun 17 08:52:05.881457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 08:52:05.881457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 08:52:05.882564 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b131c0701a0843f193e9a876b03a730c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b131c0701a0843f193e9a876b03a730c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b131c0701a0843f193e9a876b03a730c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b131c0701a0843f193e9a876b03a730c"}]}] Jun 17 08:52:05.882564 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-VolumesNegativeTest-1748467710 Jun 17 08:52:05.882564 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: b131c0701a0843f193e9a876b03a730c Jun 17 08:52:05.882564 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-VolumesNegativeTest-1748467710 Jun 17 08:52:05.882564 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-VolumesNegativeTest-1748467710-project Jun 17 08:52:05.882564 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 08:52:05.882564 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 08:52:05.882564 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: 5d745e4dd1b742f7a7e1255bb4ffd664 Jun 17 08:52:05.882564 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-VolumesNegativeTest-1748467710-project Jun 17 08:52:05.882564 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: Jun 17 08:52:05.882564 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Volume tempest-invalid-358722190 could not be found. Jun 17 08:52:05.882564 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'id': 'tempest-invalid-358722190'} Jun 17 08:52:05.882564 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:52:05.883280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:05.883280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:52:05.883280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:52:05.883280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 08:52:05.883280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 08:52:05.883280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 08:52:05.883280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 08:52:05.883280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 08:52:05.883280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 08:52:05.883280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 08:52:05.883280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 08:52:05.883280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:52:05.883280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:52:05.883280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:52:05.883280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:52:05.883280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-358722190 could not be found. (HTTP 404) (Request-ID: req-b9e38720-29e4-4034-a86f-0ed7c60fa389) Jun 17 08:52:05.883280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.883280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:05.883280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.889940 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:05.889940 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 17 08:52:05.889940 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 17 08:52:05.889940 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 08:52:05.889940 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 08:52:05.889940 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 08:52:05.889940 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 08:52:05.889940 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 08:52:05.889940 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 08:52:05.889940 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:52:05.889940 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:52:05.889940 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 08:52:05.889940 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 08:52:05.889940 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 08:52:05.889940 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 08:52:05.889940 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 08:52:05.889940 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 08:52:05.889940 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 08:52:05.889940 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 08:52:05.890889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:52:05.890889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:52:05.890889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:52:05.890889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:52:05.890889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-358722190 could not be found. Jun 17 08:52:05.890889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.890889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:05.890889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.890889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:05.890889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:05.890889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:05.890889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:52:05.890889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:52:05.890889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 08:52:05.890889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 08:52:05.890889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:52:05.890889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:52:05.890889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 17 08:52:05.890889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:52:05.890889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-358722190 could not be found. Jun 17 08:52:05.892404 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.892404 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:05.892404 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.892404 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:05.892404 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:05.892404 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:05.892404 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:52:05.892404 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:52:05.892404 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-358722190 could not be found. Jun 17 08:52:05.892404 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.892404 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-7fabb4b1-aadf-4d40-bdf1-923430ad2da8 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] Returning 404 to user: Volume tempest-invalid-358722190 could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:52:05.892404 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-7fabb4b1-aadf-4d40-bdf1-923430ad2da8 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/tempest-invalid-358722190" status: 404 len: 98 microversion: 2.1 time: 0.044502 Jun 17 08:52:05.892404 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 30/61] 10.222.0.78 () {58 vars in 1214 bytes} [Fri Jun 17 08:52:05 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-358722190 => generated 98 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 17 08:52:05.900158 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-3e8a1944-f6ff-4d97-bc4f-78fbdce5b97d tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006285 Jun 17 08:52:05.905369 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 32/62] 10.222.0.78 () {58 vars in 1139 bytes} [Fri Jun 17 08:52:05 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 17 08:52:05.910545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-6fdecf86-7f63-472d-b1c3-40d927f1b354 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003869 Jun 17 08:52:05.911213 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 31/63] 10.222.0.78 () {58 vars in 1136 bytes} [Fri Jun 17 08:52:05 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 17 08:52:05.920884 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-76f7d298-cb7e-4b1e-a12b-d1eb4483fe52 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] Calling method '.version_select at 0x7fbc33fb2b80>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:05.963986 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-76f7d298-cb7e-4b1e-a12b-d1eb4483fe52 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] HTTP exception thrown: Volume ad91ac77-25c0-48b2-89b4-5adacef011be could not be found. Jun 17 08:52:05.965967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-76f7d298-cb7e-4b1e-a12b-d1eb4483fe52 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] Request method failure captured: Jun 17 08:52:05.965967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: DELETE /compute/v2.1/os-volumes/ad91ac77-25c0-48b2-89b4-5adacef011be HTTP/1.1 Jun 17 08:52:05.965967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:52:05.965967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:52:05.965967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:52:05.965967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 08:52:05.965967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:52:05.965967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:52:05.965967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:52:05.965967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:52:05.965967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirEC1wAxyciYdZ9dryssNLHUl-KsKTim5U-7kXE_2BJ2YSBYb_oG_YCUCr_FXn-BtSqAEF1zfw4Up-_4kgbzTAd_ZmDs3ogaSjNjqnrYTi2mKAeBWiKu6dsCGTO6Pr3AgIXqhm3CQ6XBSenB91yoKcbyTk2Bw1aTYT5tLXnWg7UZSHKs Jun 17 08:52:05.965967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:52:05.965967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:52:05.965967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:52:05.965967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:52:05.965967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:52:05.965967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:52:05.965967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: b131c0701a0843f193e9a876b03a730c Jun 17 08:52:05.965967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-VolumesNegativeTest-1748467710 Jun 17 08:52:05.965967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:52:05.965967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:52:05.967311 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b131c0701a0843f193e9a876b03a730c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b131c0701a0843f193e9a876b03a730c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b131c0701a0843f193e9a876b03a730c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b131c0701a0843f193e9a876b03a730c"}]}] Jun 17 08:52:05.967311 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-VolumesNegativeTest-1748467710 Jun 17 08:52:05.967311 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: b131c0701a0843f193e9a876b03a730c Jun 17 08:52:05.967311 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-VolumesNegativeTest-1748467710 Jun 17 08:52:05.967311 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-VolumesNegativeTest-1748467710-project Jun 17 08:52:05.967311 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:52:05.967311 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:52:05.967311 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: 5d745e4dd1b742f7a7e1255bb4ffd664 Jun 17 08:52:05.967311 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-VolumesNegativeTest-1748467710-project Jun 17 08:52:05.967311 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: Jun 17 08:52:05.967311 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Volume ad91ac77-25c0-48b2-89b4-5adacef011be could not be found. Jun 17 08:52:05.967311 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'id': 'ad91ac77-25c0-48b2-89b4-5adacef011be'} Jun 17 08:52:05.967311 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:52:05.968139 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:05.968139 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:52:05.968139 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:52:05.968139 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 08:52:05.968139 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 08:52:05.968139 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 08:52:05.968139 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 08:52:05.968139 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 08:52:05.968139 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 08:52:05.968139 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 08:52:05.968139 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 08:52:05.968139 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:52:05.968139 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:52:05.968139 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:52:05.968139 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:52:05.968139 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad91ac77-25c0-48b2-89b4-5adacef011be could not be found. (HTTP 404) (Request-ID: req-37a8e78b-9406-479c-9b9a-e6a8f85d6d56) Jun 17 08:52:05.968139 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.968139 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:05.968139 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.969288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:05.969288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 17 08:52:05.969288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 17 08:52:05.969288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 08:52:05.969288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 08:52:05.969288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 08:52:05.969288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 08:52:05.969288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 08:52:05.969288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 08:52:05.969288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:52:05.969288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:52:05.969288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 08:52:05.969288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 08:52:05.969288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 08:52:05.969288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 08:52:05.969288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 08:52:05.969288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 08:52:05.969288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 08:52:05.969288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 08:52:05.971079 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:52:05.971079 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:52:05.971079 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:52:05.971079 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:52:05.971079 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad91ac77-25c0-48b2-89b4-5adacef011be could not be found. Jun 17 08:52:05.971079 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.971079 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:05.971079 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.971079 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:05.971079 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:05.971079 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:05.971079 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:52:05.971079 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:52:05.971079 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 08:52:05.971079 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 08:52:05.971079 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:52:05.971079 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:52:05.971079 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 17 08:52:05.971079 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:52:05.975907 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad91ac77-25c0-48b2-89b4-5adacef011be could not be found. Jun 17 08:52:05.975907 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.975907 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:05.975907 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.975907 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:05.975907 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:05.975907 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:05.975907 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:52:05.975907 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:52:05.975907 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad91ac77-25c0-48b2-89b4-5adacef011be could not be found. Jun 17 08:52:05.975907 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:05.975907 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-76f7d298-cb7e-4b1e-a12b-d1eb4483fe52 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] Returning 404 to user: Volume ad91ac77-25c0-48b2-89b4-5adacef011be could not be found. {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:52:05.975907 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-76f7d298-cb7e-4b1e-a12b-d1eb4483fe52 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/ad91ac77-25c0-48b2-89b4-5adacef011be" status: 404 len: 109 microversion: 2.1 time: 0.054731 Jun 17 08:52:05.978413 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 33/64] 10.222.0.78 () {58 vars in 1247 bytes} [Fri Jun 17 08:52:05 2022] DELETE /compute/v2.1/os-volumes/ad91ac77-25c0-48b2-89b4-5adacef011be => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:52:05.984249 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-f73c878e-efee-44cb-97f7-7aef8b9d55c8 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] Calling method '.version_select at 0x7fbc4072d670>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:06.067730 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-f73c878e-efee-44cb-97f7-7aef8b9d55c8 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] HTTP exception thrown: Volume 97c4669a-85ed-41e1-a908-4268edaadbf5 could not be found. Jun 17 08:52:06.070959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-f73c878e-efee-44cb-97f7-7aef8b9d55c8 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] Request method failure captured: Jun 17 08:52:06.070959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: GET /compute/v2.1/os-volumes/97c4669a-85ed-41e1-a908-4268edaadbf5 HTTP/1.1 Jun 17 08:52:06.070959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 08:52:06.070959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 08:52:06.070959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 08:52:06.070959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 08:52:06.070959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 08:52:06.070959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 08:52:06.070959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 08:52:06.070959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 08:52:06.070959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirEC1wAxyciYdZ9dryssNLHUl-KsKTim5U-7kXE_2BJ2YSBYb_oG_YCUCr_FXn-BtSqAEF1zfw4Up-_4kgbzTAd_ZmDs3ogaSjNjqnrYTi2mKAeBWiKu6dsCGTO6Pr3AgIXqhm3CQ6XBSenB91yoKcbyTk2Bw1aTYT5tLXnWg7UZSHKs Jun 17 08:52:06.070959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 08:52:06.070959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 08:52:06.070959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 08:52:06.070959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 08:52:06.070959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 08:52:06.070959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 08:52:06.070959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: b131c0701a0843f193e9a876b03a730c Jun 17 08:52:06.070959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-VolumesNegativeTest-1748467710 Jun 17 08:52:06.070959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 08:52:06.070959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 08:52:06.072364 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b131c0701a0843f193e9a876b03a730c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b131c0701a0843f193e9a876b03a730c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b131c0701a0843f193e9a876b03a730c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b131c0701a0843f193e9a876b03a730c"}]}] Jun 17 08:52:06.072364 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-VolumesNegativeTest-1748467710 Jun 17 08:52:06.072364 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: b131c0701a0843f193e9a876b03a730c Jun 17 08:52:06.072364 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-VolumesNegativeTest-1748467710 Jun 17 08:52:06.072364 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-VolumesNegativeTest-1748467710-project Jun 17 08:52:06.072364 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 08:52:06.072364 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 08:52:06.072364 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: 5d745e4dd1b742f7a7e1255bb4ffd664 Jun 17 08:52:06.072364 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-VolumesNegativeTest-1748467710-project Jun 17 08:52:06.072364 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: Jun 17 08:52:06.072364 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Volume 97c4669a-85ed-41e1-a908-4268edaadbf5 could not be found. Jun 17 08:52:06.072364 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'id': '97c4669a-85ed-41e1-a908-4268edaadbf5'} Jun 17 08:52:06.072364 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:52:06.073262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:06.073262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:52:06.073262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:52:06.073262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 08:52:06.073262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 08:52:06.073262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 08:52:06.073262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 08:52:06.073262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 08:52:06.073262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 08:52:06.073262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 08:52:06.073262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 08:52:06.073262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:52:06.073262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:52:06.073262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:52:06.073262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:52:06.073262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 97c4669a-85ed-41e1-a908-4268edaadbf5 could not be found. (HTTP 404) (Request-ID: req-16768889-0887-409d-98c3-2f1fb3772f96) Jun 17 08:52:06.073262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:06.073262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:06.073262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:06.074424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:06.074424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 08:52:06.074424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 08:52:06.074424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 08:52:06.074424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 08:52:06.074424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 08:52:06.074424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 08:52:06.074424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 08:52:06.074424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 08:52:06.074424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:52:06.074424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:52:06.074424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 08:52:06.074424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 08:52:06.074424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 08:52:06.074424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 08:52:06.074424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 08:52:06.074424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 08:52:06.074424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 08:52:06.074424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 08:52:06.075874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:52:06.075874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:52:06.075874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:52:06.075874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:52:06.075874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 97c4669a-85ed-41e1-a908-4268edaadbf5 could not be found. Jun 17 08:52:06.075874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:06.075874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:06.075874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:06.075874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:06.075874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:06.075874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:06.075874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:52:06.075874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:52:06.075874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 08:52:06.075874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 08:52:06.075874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:52:06.075874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:52:06.075874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 08:52:06.075874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:52:06.077907 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 97c4669a-85ed-41e1-a908-4268edaadbf5 could not be found. Jun 17 08:52:06.077907 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:06.077907 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:06.077907 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:06.077907 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:06.077907 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:06.077907 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:06.077907 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:52:06.077907 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:52:06.077907 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 97c4669a-85ed-41e1-a908-4268edaadbf5 could not be found. Jun 17 08:52:06.077907 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:06.077907 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-f73c878e-efee-44cb-97f7-7aef8b9d55c8 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] Returning 404 to user: Volume 97c4669a-85ed-41e1-a908-4268edaadbf5 could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:52:06.077907 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-f73c878e-efee-44cb-97f7-7aef8b9d55c8 tempest-VolumesNegativeTest-1748467710 tempest-VolumesNegativeTest-1748467710-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/97c4669a-85ed-41e1-a908-4268edaadbf5" status: 404 len: 109 microversion: 2.1 time: 0.097540 Jun 17 08:52:06.083894 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 32/65] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jun 17 08:52:05 2022] GET /compute/v2.1/os-volumes/97c4669a-85ed-41e1-a908-4268edaadbf5 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 08:52:06.093893 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-adf8f04a-8e4b-47a3-8df5-a0ba8ba67e6a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:06.094682 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-adf8f04a-8e4b-47a3-8df5-a0ba8ba67e6a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:06.106792 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-adf8f04a-8e4b-47a3-8df5-a0ba8ba67e6a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:06.107277 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-adf8f04a-8e4b-47a3-8df5-a0ba8ba67e6a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:06.108144 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-adf8f04a-8e4b-47a3-8df5-a0ba8ba67e6a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:06.108599 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-adf8f04a-8e4b-47a3-8df5-a0ba8ba67e6a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:06.268270 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-adf8f04a-8e4b-47a3-8df5-a0ba8ba67e6a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:06.278175 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-adf8f04a-8e4b-47a3-8df5-a0ba8ba67e6a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1299 microversion: 2.1 time: 0.189234 Jun 17 08:52:06.294891 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 34/66] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:06 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1299 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:06.325840 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-15794d93-08bb-4741-91ee-e8127cb173a4 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:06.326472 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-15794d93-08bb-4741-91ee-e8127cb173a4 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:06.352838 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-15794d93-08bb-4741-91ee-e8127cb173a4 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:06.357082 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-15794d93-08bb-4741-91ee-e8127cb173a4 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:06.358003 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-15794d93-08bb-4741-91ee-e8127cb173a4 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:06.358463 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-15794d93-08bb-4741-91ee-e8127cb173a4 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:06.518075 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-6b89eb5f-79be-4a92-9dbc-8d4e43ed525b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:06.518719 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-6b89eb5f-79be-4a92-9dbc-8d4e43ed525b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:06.526380 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6b89eb5f-79be-4a92-9dbc-8d4e43ed525b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:06.526839 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6b89eb5f-79be-4a92-9dbc-8d4e43ed525b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:06.529216 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6b89eb5f-79be-4a92-9dbc-8d4e43ed525b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:06.529885 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6b89eb5f-79be-4a92-9dbc-8d4e43ed525b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:06.663116 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-6b89eb5f-79be-4a92-9dbc-8d4e43ed525b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:06.675596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-6b89eb5f-79be-4a92-9dbc-8d4e43ed525b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:06.677727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-6b89eb5f-79be-4a92-9dbc-8d4e43ed525b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:06.680196 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-6b89eb5f-79be-4a92-9dbc-8d4e43ed525b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1341 microversion: 2.20 time: 0.166738 Jun 17 08:52:06.681634 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 35/67] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:06 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1341 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:52:06.769250 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-15794d93-08bb-4741-91ee-e8127cb173a4 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:06.783073 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-15794d93-08bb-4741-91ee-e8127cb173a4 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1315 microversion: 2.1 time: 0.466398 Jun 17 08:52:06.783972 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 33/68] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:06 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:07.313991 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-2ff49b1b-5515-425c-9b11-6bd7247a66d5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:07.314778 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-2ff49b1b-5515-425c-9b11-6bd7247a66d5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:07.325114 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2ff49b1b-5515-425c-9b11-6bd7247a66d5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:07.328701 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2ff49b1b-5515-425c-9b11-6bd7247a66d5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:07.329776 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2ff49b1b-5515-425c-9b11-6bd7247a66d5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:07.331377 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2ff49b1b-5515-425c-9b11-6bd7247a66d5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:07.706683 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-41d4a6e8-63df-4933-b749-70de34a6bfb1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:07.708335 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-41d4a6e8-63df-4933-b749-70de34a6bfb1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:07.724189 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-41d4a6e8-63df-4933-b749-70de34a6bfb1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:07.725444 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-41d4a6e8-63df-4933-b749-70de34a6bfb1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:07.730168 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-41d4a6e8-63df-4933-b749-70de34a6bfb1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:07.730629 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-41d4a6e8-63df-4933-b749-70de34a6bfb1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:08.293800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-41d4a6e8-63df-4933-b749-70de34a6bfb1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:08.308823 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-41d4a6e8-63df-4933-b749-70de34a6bfb1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:08.310051 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-41d4a6e8-63df-4933-b749-70de34a6bfb1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:08.326112 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-41d4a6e8-63df-4933-b749-70de34a6bfb1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1339 microversion: 2.20 time: 0.615120 Jun 17 08:52:08.326797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 34/69] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:07 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1339 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:52:08.352862 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0364e7dc-41ea-48d2-8265-0f09eb9c7e84 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:08.359935 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0364e7dc-41ea-48d2-8265-0f09eb9c7e84 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:08.389487 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0364e7dc-41ea-48d2-8265-0f09eb9c7e84 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:08.390470 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0364e7dc-41ea-48d2-8265-0f09eb9c7e84 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:08.392955 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0364e7dc-41ea-48d2-8265-0f09eb9c7e84 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:08.393913 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0364e7dc-41ea-48d2-8265-0f09eb9c7e84 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:08.455098 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-2ff49b1b-5515-425c-9b11-6bd7247a66d5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:08.471678 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-2ff49b1b-5515-425c-9b11-6bd7247a66d5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1367 microversion: 2.1 time: 1.161961 Jun 17 08:52:08.491229 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 36/70] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:07 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1367 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:09.017668 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0364e7dc-41ea-48d2-8265-0f09eb9c7e84 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:09.029760 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0364e7dc-41ea-48d2-8265-0f09eb9c7e84 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1315 microversion: 2.1 time: 0.701771 Jun 17 08:52:09.041118 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 35/71] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:08 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1315 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:09.348888 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-fd950874-d7bd-4239-bbe5-3fce184a7df3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:09.349659 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-fd950874-d7bd-4239-bbe5-3fce184a7df3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:09.361684 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fd950874-d7bd-4239-bbe5-3fce184a7df3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:09.375023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fd950874-d7bd-4239-bbe5-3fce184a7df3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:09.376274 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fd950874-d7bd-4239-bbe5-3fce184a7df3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:09.377818 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fd950874-d7bd-4239-bbe5-3fce184a7df3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:09.486824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-fd950874-d7bd-4239-bbe5-3fce184a7df3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:09.498429 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-2ff43b8f-33dc-4f90-98b7-db3377d7a0c9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:09.498973 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-2ff43b8f-33dc-4f90-98b7-db3377d7a0c9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:09.507421 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2ff43b8f-33dc-4f90-98b7-db3377d7a0c9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:09.508161 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2ff43b8f-33dc-4f90-98b7-db3377d7a0c9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:09.508563 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-fd950874-d7bd-4239-bbe5-3fce184a7df3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:09.509383 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2ff43b8f-33dc-4f90-98b7-db3377d7a0c9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:09.510015 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2ff43b8f-33dc-4f90-98b7-db3377d7a0c9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:09.512536 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-fd950874-d7bd-4239-bbe5-3fce184a7df3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:09.519847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-fd950874-d7bd-4239-bbe5-3fce184a7df3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1339 microversion: 2.20 time: 0.171473 Jun 17 08:52:09.520639 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 37/72] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:09 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1339 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:52:09.828600 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2ff43b8f-33dc-4f90-98b7-db3377d7a0c9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:09.856770 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-2ff43b8f-33dc-4f90-98b7-db3377d7a0c9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1367 microversion: 2.1 time: 0.343210 Jun 17 08:52:09.856770 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 36/73] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:09 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1367 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:52:10.055514 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-ea1cb9db-d537-4730-a406-4f7bbd575642 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:10.055514 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-ea1cb9db-d537-4730-a406-4f7bbd575642 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:10.070030 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ea1cb9db-d537-4730-a406-4f7bbd575642 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:10.071051 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ea1cb9db-d537-4730-a406-4f7bbd575642 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:10.091934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ea1cb9db-d537-4730-a406-4f7bbd575642 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:10.091934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ea1cb9db-d537-4730-a406-4f7bbd575642 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:10.540357 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=4 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:10.542681 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-c9953cc9-0531-41f1-a0b5-463bf8f8a487 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:10.543461 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-c9953cc9-0531-41f1-a0b5-463bf8f8a487 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:10.560742 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c9953cc9-0531-41f1-a0b5-463bf8f8a487 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:10.563789 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c9953cc9-0531-41f1-a0b5-463bf8f8a487 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:10.566311 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c9953cc9-0531-41f1-a0b5-463bf8f8a487 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:10.570146 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c9953cc9-0531-41f1-a0b5-463bf8f8a487 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:11.164575 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-ea1cb9db-d537-4730-a406-4f7bbd575642 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:11.189081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c9953cc9-0531-41f1-a0b5-463bf8f8a487 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:11.192671 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-ea1cb9db-d537-4730-a406-4f7bbd575642 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1315 microversion: 2.1 time: 1.148728 Jun 17 08:52:11.196571 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 38/74] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:10 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1315 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:11.209638 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-3a8c5f9d-9adc-4e6f-aac7-83a22ffe8b9f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:11.209638 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-3a8c5f9d-9adc-4e6f-aac7-83a22ffe8b9f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:11.219073 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c9953cc9-0531-41f1-a0b5-463bf8f8a487 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:11.221076 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c9953cc9-0531-41f1-a0b5-463bf8f8a487 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:11.222236 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-c9953cc9-0531-41f1-a0b5-463bf8f8a487 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1406 microversion: 2.20 time: 0.686334 Jun 17 08:52:11.224283 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 37/75] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:10 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1406 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:52:11.241766 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3a8c5f9d-9adc-4e6f-aac7-83a22ffe8b9f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:11.242219 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3a8c5f9d-9adc-4e6f-aac7-83a22ffe8b9f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:11.243203 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3a8c5f9d-9adc-4e6f-aac7-83a22ffe8b9f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:11.243869 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3a8c5f9d-9adc-4e6f-aac7-83a22ffe8b9f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:11.811492 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-3a8c5f9d-9adc-4e6f-aac7-83a22ffe8b9f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:11.857088 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-3a8c5f9d-9adc-4e6f-aac7-83a22ffe8b9f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1367 microversion: 2.1 time: 0.655573 Jun 17 08:52:11.858678 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 39/76] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:11 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1367 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:12.226298 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-bc6257ec-ba29-45c3-9995-1f9592a78d6a tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:12.228359 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-bc6257ec-ba29-45c3-9995-1f9592a78d6a tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:12.239241 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bc6257ec-ba29-45c3-9995-1f9592a78d6a tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:12.239745 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bc6257ec-ba29-45c3-9995-1f9592a78d6a tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:12.243917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bc6257ec-ba29-45c3-9995-1f9592a78d6a tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:12.244378 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bc6257ec-ba29-45c3-9995-1f9592a78d6a tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:12.245827 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-62043ae1-c91d-47ea-add2-e6f4ef7b3335 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:12.247382 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-62043ae1-c91d-47ea-add2-e6f4ef7b3335 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:12.275048 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-62043ae1-c91d-47ea-add2-e6f4ef7b3335 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:12.275869 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-62043ae1-c91d-47ea-add2-e6f4ef7b3335 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:12.278446 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-62043ae1-c91d-47ea-add2-e6f4ef7b3335 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:12.280405 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-62043ae1-c91d-47ea-add2-e6f4ef7b3335 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:12.686111 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=2 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:12.987342 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-62043ae1-c91d-47ea-add2-e6f4ef7b3335 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:12.998756 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-62043ae1-c91d-47ea-add2-e6f4ef7b3335 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:13.006301 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-bc6257ec-ba29-45c3-9995-1f9592a78d6a tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:13.008653 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-62043ae1-c91d-47ea-add2-e6f4ef7b3335 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:13.009840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-62043ae1-c91d-47ea-add2-e6f4ef7b3335 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1406 microversion: 2.20 time: 0.771461 Jun 17 08:52:13.010729 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 40/77] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:12 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1406 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:52:13.033901 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-bc6257ec-ba29-45c3-9995-1f9592a78d6a tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1315 microversion: 2.1 time: 0.823068 Jun 17 08:52:13.047392 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 38/78] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:12 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1315 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:13.050817 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-fe02f3c5-4d54-4a9b-bc77-048184673f17 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:13.059884 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-fe02f3c5-4d54-4a9b-bc77-048184673f17 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:13.075443 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fe02f3c5-4d54-4a9b-bc77-048184673f17 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:13.075813 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fe02f3c5-4d54-4a9b-bc77-048184673f17 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:13.076530 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fe02f3c5-4d54-4a9b-bc77-048184673f17 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:13.077045 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fe02f3c5-4d54-4a9b-bc77-048184673f17 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:13.129938 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=22 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:13.570009 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-fe02f3c5-4d54-4a9b-bc77-048184673f17 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:13.584893 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-fe02f3c5-4d54-4a9b-bc77-048184673f17 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1367 microversion: 2.1 time: 0.540960 Jun 17 08:52:13.589163 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 39/79] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:13 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1367 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:13.874296 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-431d3001-56ea-404c-b8bd-9c2b5acefd96 req-a1c80bd8-c37d-4e3d-ac3f-d3a2d3f0e269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42469758-d2b8-4bde-92f6-0b7ef5528fbc", "tag": "62eb07ca-d310-44bf-a6bd-62e5e42d4403"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:52:13.940496 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-431d3001-56ea-404c-b8bd-9c2b5acefd96 req-a1c80bd8-c37d-4e3d-ac3f-d3a2d3f0e269 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:13.941563 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-431d3001-56ea-404c-b8bd-9c2b5acefd96 req-a1c80bd8-c37d-4e3d-ac3f-d3a2d3f0e269 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:13.992282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-431d3001-56ea-404c-b8bd-9c2b5acefd96 req-a1c80bd8-c37d-4e3d-ac3f-d3a2d3f0e269 service nova] Creating event network-changed:62eb07ca-d310-44bf-a6bd-62e5e42d4403 for instance 42469758-d2b8-4bde-92f6-0b7ef5528fbc on hv-cinder-79760 Jun 17 08:52:13.992876 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-431d3001-56ea-404c-b8bd-9c2b5acefd96 req-a1c80bd8-c37d-4e3d-ac3f-d3a2d3f0e269 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129876) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 17 08:52:13.993778 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-921414d0-34fd-40cf-b76d-29045cdac7b6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:13.994178 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-921414d0-34fd-40cf-b76d-29045cdac7b6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:13.995122 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-921414d0-34fd-40cf-b76d-29045cdac7b6 None None] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:13.995727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-921414d0-34fd-40cf-b76d-29045cdac7b6 None None] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:14.008528 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.compute.rpcapi [None req-921414d0-34fd-40cf-b76d-29045cdac7b6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 17 08:52:14.009782 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-921414d0-34fd-40cf-b76d-29045cdac7b6 None None] Releasing lock "compute-rpcapi-router" {{(pid=129876) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 17 08:52:14.031008 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-921414d0-34fd-40cf-b76d-29045cdac7b6 None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.019041 Jun 17 08:52:14.032315 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 41/80] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:52:14.040027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-76651e1c-fc56-4c9c-9e24-dd29b0d60fc2 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:14.040960 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-76651e1c-fc56-4c9c-9e24-dd29b0d60fc2 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:14.053639 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-76651e1c-fc56-4c9c-9e24-dd29b0d60fc2 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:14.054923 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-76651e1c-fc56-4c9c-9e24-dd29b0d60fc2 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:14.056495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-76651e1c-fc56-4c9c-9e24-dd29b0d60fc2 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:14.057323 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-76651e1c-fc56-4c9c-9e24-dd29b0d60fc2 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:14.250659 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=16 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:14.300498 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-76651e1c-fc56-4c9c-9e24-dd29b0d60fc2 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:14.323249 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-76651e1c-fc56-4c9c-9e24-dd29b0d60fc2 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:14.326367 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-76651e1c-fc56-4c9c-9e24-dd29b0d60fc2 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:14.331318 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-76651e1c-fc56-4c9c-9e24-dd29b0d60fc2 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1406 microversion: 2.20 time: 0.297038 Jun 17 08:52:14.334605 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 42/81] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:14 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1406 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:52:14.347697 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-da405fea-342c-4e91-bf02-63214f79bb33 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:14.352053 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-da405fea-342c-4e91-bf02-63214f79bb33 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:14.371688 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-576c28d1-c6a3-43dd-ba12-fba52e60b72f req-56a97e15-6465-41e7-83df-246204e8a896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a2cc759-7f2e-4308-aaf4-8ac7befa64de", "tag": "b089d395-a218-45c9-907d-df2425df186f"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:52:14.373381 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-da405fea-342c-4e91-bf02-63214f79bb33 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:14.375256 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-da405fea-342c-4e91-bf02-63214f79bb33 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:14.377606 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-da405fea-342c-4e91-bf02-63214f79bb33 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:14.381680 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-da405fea-342c-4e91-bf02-63214f79bb33 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:14.395880 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-576c28d1-c6a3-43dd-ba12-fba52e60b72f req-56a97e15-6465-41e7-83df-246204e8a896 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:14.396346 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-576c28d1-c6a3-43dd-ba12-fba52e60b72f req-56a97e15-6465-41e7-83df-246204e8a896 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:14.454485 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-576c28d1-c6a3-43dd-ba12-fba52e60b72f req-56a97e15-6465-41e7-83df-246204e8a896 service nova] Creating event network-changed:b089d395-a218-45c9-907d-df2425df186f for instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de on hv-cinder-79760 Jun 17 08:52:14.455376 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-576c28d1-c6a3-43dd-ba12-fba52e60b72f req-56a97e15-6465-41e7-83df-246204e8a896 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 17 08:52:14.456996 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-cc3fd037-a435-4723-8b45-48c351b1af7b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:14.457699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-cc3fd037-a435-4723-8b45-48c351b1af7b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:14.458819 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-cc3fd037-a435-4723-8b45-48c351b1af7b None None] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:14.459554 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-cc3fd037-a435-4723-8b45-48c351b1af7b None None] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:14.471340 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.compute.rpcapi [None req-cc3fd037-a435-4723-8b45-48c351b1af7b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 17 08:52:14.472613 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-cc3fd037-a435-4723-8b45-48c351b1af7b None None] Releasing lock "compute-rpcapi-router" {{(pid=129875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 17 08:52:14.527295 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-cc3fd037-a435-4723-8b45-48c351b1af7b None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.742114 Jun 17 08:52:14.528768 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 40/82] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:52:14.612394 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-531bec30-8d70-4633-b8ca-168499b6f78d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:14.613787 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-531bec30-8d70-4633-b8ca-168499b6f78d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:14.628109 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-531bec30-8d70-4633-b8ca-168499b6f78d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:14.636436 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-531bec30-8d70-4633-b8ca-168499b6f78d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:14.636436 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-531bec30-8d70-4633-b8ca-168499b6f78d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:14.636436 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-531bec30-8d70-4633-b8ca-168499b6f78d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:14.716582 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-da405fea-342c-4e91-bf02-63214f79bb33 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:14.734677 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-da405fea-342c-4e91-bf02-63214f79bb33 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1315 microversion: 2.1 time: 0.398431 Jun 17 08:52:14.735275 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 43/83] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:14 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:15.228337 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-531bec30-8d70-4633-b8ca-168499b6f78d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:15.240999 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-531bec30-8d70-4633-b8ca-168499b6f78d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1367 microversion: 2.1 time: 0.638123 Jun 17 08:52:15.275342 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 41/84] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:14 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1367 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:52:15.355585 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a4a9ddd3-0afb-4355-b799-1214de6388ff tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:15.356266 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a4a9ddd3-0afb-4355-b799-1214de6388ff tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:15.372175 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a4a9ddd3-0afb-4355-b799-1214de6388ff tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:15.372642 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a4a9ddd3-0afb-4355-b799-1214de6388ff tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:15.373524 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a4a9ddd3-0afb-4355-b799-1214de6388ff tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:15.373964 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a4a9ddd3-0afb-4355-b799-1214de6388ff tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:15.649902 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a4a9ddd3-0afb-4355-b799-1214de6388ff tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:15.658468 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a4a9ddd3-0afb-4355-b799-1214de6388ff tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:15.660050 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a4a9ddd3-0afb-4355-b799-1214de6388ff tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:15.662427 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a4a9ddd3-0afb-4355-b799-1214de6388ff tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1406 microversion: 2.20 time: 0.311502 Jun 17 08:52:15.662427 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 44/85] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:15 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1406 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:52:15.753251 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1c1a8bbe-fd19-4b6b-823e-83a89a3ff9d2 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:15.754453 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-1c1a8bbe-fd19-4b6b-823e-83a89a3ff9d2 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:15.761611 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1c1a8bbe-fd19-4b6b-823e-83a89a3ff9d2 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:15.762705 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1c1a8bbe-fd19-4b6b-823e-83a89a3ff9d2 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:15.763555 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1c1a8bbe-fd19-4b6b-823e-83a89a3ff9d2 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:15.764162 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1c1a8bbe-fd19-4b6b-823e-83a89a3ff9d2 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:15.976652 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-1c1a8bbe-fd19-4b6b-823e-83a89a3ff9d2 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:15.988931 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-1c1a8bbe-fd19-4b6b-823e-83a89a3ff9d2 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1315 microversion: 2.1 time: 0.239697 Jun 17 08:52:15.999800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 42/86] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:15 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:16.270324 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e825e44a-738f-4d72-8539-f7822c5b443c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:16.271224 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-e825e44a-738f-4d72-8539-f7822c5b443c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:16.286325 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e825e44a-738f-4d72-8539-f7822c5b443c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:16.286325 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e825e44a-738f-4d72-8539-f7822c5b443c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:16.286325 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e825e44a-738f-4d72-8539-f7822c5b443c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:16.286325 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e825e44a-738f-4d72-8539-f7822c5b443c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:16.511618 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e825e44a-738f-4d72-8539-f7822c5b443c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:16.519685 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-e825e44a-738f-4d72-8539-f7822c5b443c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1367 microversion: 2.1 time: 0.254670 Jun 17 08:52:16.524878 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 45/87] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:16 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:16.549656 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-d190632e-6d56-422c-91e2-317db56aed3b req-3200a2ca-6cad-4254-9bed-caf51a1427ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "397d996b-b163-4a47-856e-f2aca2ae6976", "tag": "051f4b45-cbb1-44c1-92a3-54becef75c28"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:52:16.558577 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-d190632e-6d56-422c-91e2-317db56aed3b req-3200a2ca-6cad-4254-9bed-caf51a1427ec service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:16.559618 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-d190632e-6d56-422c-91e2-317db56aed3b req-3200a2ca-6cad-4254-9bed-caf51a1427ec service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:16.576987 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-d190632e-6d56-422c-91e2-317db56aed3b req-3200a2ca-6cad-4254-9bed-caf51a1427ec service nova] Creating event network-changed:051f4b45-cbb1-44c1-92a3-54becef75c28 for instance 397d996b-b163-4a47-856e-f2aca2ae6976 on hv-cinder-79760 Jun 17 08:52:16.585086 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-d190632e-6d56-422c-91e2-317db56aed3b req-3200a2ca-6cad-4254-9bed-caf51a1427ec service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037866 Jun 17 08:52:16.586284 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 43/88] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:52:16.681084 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-881b497f-df41-4aa2-8b78-8972d3ae9891 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:16.682104 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-881b497f-df41-4aa2-8b78-8972d3ae9891 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:16.689601 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-881b497f-df41-4aa2-8b78-8972d3ae9891 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:16.690064 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-881b497f-df41-4aa2-8b78-8972d3ae9891 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:16.690932 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-881b497f-df41-4aa2-8b78-8972d3ae9891 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:16.691628 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-881b497f-df41-4aa2-8b78-8972d3ae9891 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:16.944894 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-881b497f-df41-4aa2-8b78-8972d3ae9891 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:16.972866 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-881b497f-df41-4aa2-8b78-8972d3ae9891 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:16.975167 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-881b497f-df41-4aa2-8b78-8972d3ae9891 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:16.979823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-881b497f-df41-4aa2-8b78-8972d3ae9891 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1406 microversion: 2.20 time: 0.302740 Jun 17 08:52:16.981247 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 46/89] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:16 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1406 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:52:17.009084 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-e18de088-48b4-452b-bb07-f06f3daad47c tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:17.010075 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-e18de088-48b4-452b-bb07-f06f3daad47c tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:17.027410 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e18de088-48b4-452b-bb07-f06f3daad47c tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:17.028333 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e18de088-48b4-452b-bb07-f06f3daad47c tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:17.029974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e18de088-48b4-452b-bb07-f06f3daad47c tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:17.030700 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e18de088-48b4-452b-bb07-f06f3daad47c tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:17.194468 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-e18de088-48b4-452b-bb07-f06f3daad47c tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:17.205770 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-e18de088-48b4-452b-bb07-f06f3daad47c tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1315 microversion: 2.1 time: 0.200616 Jun 17 08:52:17.206986 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 44/90] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:17 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:17.548308 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-2cec2143-5a7d-42c6-ab0c-2cd9d1d11e90 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:17.548938 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-2cec2143-5a7d-42c6-ab0c-2cd9d1d11e90 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:17.557286 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2cec2143-5a7d-42c6-ab0c-2cd9d1d11e90 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:17.557979 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2cec2143-5a7d-42c6-ab0c-2cd9d1d11e90 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:17.559742 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2cec2143-5a7d-42c6-ab0c-2cd9d1d11e90 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:17.561676 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2cec2143-5a7d-42c6-ab0c-2cd9d1d11e90 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:17.569495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=100 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:17.822895 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-2cec2143-5a7d-42c6-ab0c-2cd9d1d11e90 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:17.831255 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-2cec2143-5a7d-42c6-ab0c-2cd9d1d11e90 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1367 microversion: 2.1 time: 0.292995 Jun 17 08:52:17.832308 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 47/91] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:17 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:17.999912 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-cbee39ed-c427-433f-874f-c6fe0000f829 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:18.001378 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-cbee39ed-c427-433f-874f-c6fe0000f829 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:18.016182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-cbee39ed-c427-433f-874f-c6fe0000f829 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:18.016818 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-cbee39ed-c427-433f-874f-c6fe0000f829 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:18.024321 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-cbee39ed-c427-433f-874f-c6fe0000f829 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:18.029020 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-cbee39ed-c427-433f-874f-c6fe0000f829 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:18.221630 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-cbee39ed-c427-433f-874f-c6fe0000f829 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:18.224654 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-daa14f78-4c1a-4a9e-84e7-ec29b875e755 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:18.225242 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-daa14f78-4c1a-4a9e-84e7-ec29b875e755 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:18.231127 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-cbee39ed-c427-433f-874f-c6fe0000f829 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:18.232689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-cbee39ed-c427-433f-874f-c6fe0000f829 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:18.233824 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-cbee39ed-c427-433f-874f-c6fe0000f829 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1406 microversion: 2.20 time: 0.238442 Jun 17 08:52:18.234390 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 45/92] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:17 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:52:18.239582 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-daa14f78-4c1a-4a9e-84e7-ec29b875e755 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:18.239582 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-daa14f78-4c1a-4a9e-84e7-ec29b875e755 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:18.239582 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-daa14f78-4c1a-4a9e-84e7-ec29b875e755 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:18.240620 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-daa14f78-4c1a-4a9e-84e7-ec29b875e755 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:18.463525 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-daa14f78-4c1a-4a9e-84e7-ec29b875e755 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:18.471884 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-daa14f78-4c1a-4a9e-84e7-ec29b875e755 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1315 microversion: 2.1 time: 0.251135 Jun 17 08:52:18.479387 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 48/93] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:18 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:52:18.857752 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-65878cdd-6a2a-471f-94e9-8bb0f7e63cd8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:18.858361 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-65878cdd-6a2a-471f-94e9-8bb0f7e63cd8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:18.864941 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-65878cdd-6a2a-471f-94e9-8bb0f7e63cd8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:18.866141 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-65878cdd-6a2a-471f-94e9-8bb0f7e63cd8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:18.867011 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-65878cdd-6a2a-471f-94e9-8bb0f7e63cd8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:18.867468 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-65878cdd-6a2a-471f-94e9-8bb0f7e63cd8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:19.042581 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-65878cdd-6a2a-471f-94e9-8bb0f7e63cd8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:19.050370 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-65878cdd-6a2a-471f-94e9-8bb0f7e63cd8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1367 microversion: 2.1 time: 0.196908 Jun 17 08:52:19.050960 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 46/94] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:18 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:19.252590 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-7639c1d9-fa3f-4a32-bd84-41827c43020d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:19.253904 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-7639c1d9-fa3f-4a32-bd84-41827c43020d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:19.261926 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7639c1d9-fa3f-4a32-bd84-41827c43020d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:19.262609 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7639c1d9-fa3f-4a32-bd84-41827c43020d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:19.263482 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7639c1d9-fa3f-4a32-bd84-41827c43020d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:19.264121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7639c1d9-fa3f-4a32-bd84-41827c43020d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:19.467489 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-7639c1d9-fa3f-4a32-bd84-41827c43020d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:19.475556 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-7639c1d9-fa3f-4a32-bd84-41827c43020d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:19.477328 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-7639c1d9-fa3f-4a32-bd84-41827c43020d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:19.478840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-7639c1d9-fa3f-4a32-bd84-41827c43020d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1406 microversion: 2.20 time: 0.230802 Jun 17 08:52:19.489264 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 49/95] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:19 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:52:19.504029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d5e90a40-4d09-4bee-9a0b-c5eb100d81bf tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:19.504029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-d5e90a40-4d09-4bee-9a0b-c5eb100d81bf tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:19.504029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d5e90a40-4d09-4bee-9a0b-c5eb100d81bf tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:19.504029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d5e90a40-4d09-4bee-9a0b-c5eb100d81bf tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:19.504530 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d5e90a40-4d09-4bee-9a0b-c5eb100d81bf tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:19.504530 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d5e90a40-4d09-4bee-9a0b-c5eb100d81bf tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:19.509248 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=100 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:19.706350 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d5e90a40-4d09-4bee-9a0b-c5eb100d81bf tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:19.706350 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-d5e90a40-4d09-4bee-9a0b-c5eb100d81bf tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1315 microversion: 2.1 time: 0.182887 Jun 17 08:52:19.706350 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 47/96] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:19 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:20.068174 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-ca55f561-7652-421f-a4f5-152322155523 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:20.069593 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-ca55f561-7652-421f-a4f5-152322155523 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:20.075648 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ca55f561-7652-421f-a4f5-152322155523 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:20.076229 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ca55f561-7652-421f-a4f5-152322155523 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:20.077004 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ca55f561-7652-421f-a4f5-152322155523 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:20.077594 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ca55f561-7652-421f-a4f5-152322155523 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:20.213896 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-ca55f561-7652-421f-a4f5-152322155523 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:20.224150 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-ca55f561-7652-421f-a4f5-152322155523 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1367 microversion: 2.1 time: 0.159604 Jun 17 08:52:20.224762 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 50/97] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:20 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:20.497255 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-2feeba66-150c-45d2-b163-e0224782cdda tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:20.497868 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-2feeba66-150c-45d2-b163-e0224782cdda tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:20.503948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2feeba66-150c-45d2-b163-e0224782cdda tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:20.504392 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2feeba66-150c-45d2-b163-e0224782cdda tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:20.505152 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2feeba66-150c-45d2-b163-e0224782cdda tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:20.505587 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2feeba66-150c-45d2-b163-e0224782cdda tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:20.635024 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2feeba66-150c-45d2-b163-e0224782cdda tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:20.642827 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2feeba66-150c-45d2-b163-e0224782cdda tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:20.644437 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2feeba66-150c-45d2-b163-e0224782cdda tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:20.645582 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-2feeba66-150c-45d2-b163-e0224782cdda tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1406 microversion: 2.20 time: 0.152249 Jun 17 08:52:20.646145 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 48/98] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:20 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:52:20.716180 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-50632189-8a49-4b0d-8b58-59143122b35c tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:20.716804 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-50632189-8a49-4b0d-8b58-59143122b35c tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:20.719709 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:20.723733 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-50632189-8a49-4b0d-8b58-59143122b35c tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:20.724412 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-50632189-8a49-4b0d-8b58-59143122b35c tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:20.725745 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-50632189-8a49-4b0d-8b58-59143122b35c tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:20.726186 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-50632189-8a49-4b0d-8b58-59143122b35c tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:20.874199 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-50632189-8a49-4b0d-8b58-59143122b35c tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:20.882810 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-50632189-8a49-4b0d-8b58-59143122b35c tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1315 microversion: 2.1 time: 0.170534 Jun 17 08:52:20.883763 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 51/99] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:20 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:52:21.241421 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-dd055f13-6b10-4ee9-8a1f-ad24f18e60b5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:21.242269 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-dd055f13-6b10-4ee9-8a1f-ad24f18e60b5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:21.249042 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-dd055f13-6b10-4ee9-8a1f-ad24f18e60b5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:21.249501 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-dd055f13-6b10-4ee9-8a1f-ad24f18e60b5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:21.250294 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-dd055f13-6b10-4ee9-8a1f-ad24f18e60b5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:21.250725 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-dd055f13-6b10-4ee9-8a1f-ad24f18e60b5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:21.420021 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-dd055f13-6b10-4ee9-8a1f-ad24f18e60b5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:21.430911 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-dd055f13-6b10-4ee9-8a1f-ad24f18e60b5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1367 microversion: 2.1 time: 0.193322 Jun 17 08:52:21.439108 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 49/100] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:21 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:21.666622 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-2e63cbff-82b0-4f41-a64d-2393e3a13c06 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:21.667305 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-2e63cbff-82b0-4f41-a64d-2393e3a13c06 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:21.674240 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2e63cbff-82b0-4f41-a64d-2393e3a13c06 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:21.674689 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2e63cbff-82b0-4f41-a64d-2393e3a13c06 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:21.675478 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2e63cbff-82b0-4f41-a64d-2393e3a13c06 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:21.675918 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2e63cbff-82b0-4f41-a64d-2393e3a13c06 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:21.833817 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-2e63cbff-82b0-4f41-a64d-2393e3a13c06 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:21.842384 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-2e63cbff-82b0-4f41-a64d-2393e3a13c06 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:21.843944 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-2e63cbff-82b0-4f41-a64d-2393e3a13c06 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:21.845053 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-2e63cbff-82b0-4f41-a64d-2393e3a13c06 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1406 microversion: 2.20 time: 0.182937 Jun 17 08:52:21.845613 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 52/101] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:21 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:52:21.900017 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-e8c29a1f-ca59-48db-a18c-d7da4700231d tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:21.900841 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-e8c29a1f-ca59-48db-a18c-d7da4700231d tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:21.906837 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e8c29a1f-ca59-48db-a18c-d7da4700231d tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:21.907705 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e8c29a1f-ca59-48db-a18c-d7da4700231d tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:21.908681 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e8c29a1f-ca59-48db-a18c-d7da4700231d tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:21.909558 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e8c29a1f-ca59-48db-a18c-d7da4700231d tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:22.061322 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-e8c29a1f-ca59-48db-a18c-d7da4700231d tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:22.069690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-e8c29a1f-ca59-48db-a18c-d7da4700231d tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1315 microversion: 2.1 time: 0.173456 Jun 17 08:52:22.070281 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 50/102] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:21 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:22.457032 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-d6837e5f-139b-4475-8595-1b30d6e4c276 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:22.457654 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-d6837e5f-139b-4475-8595-1b30d6e4c276 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:22.465070 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d6837e5f-139b-4475-8595-1b30d6e4c276 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:22.465516 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d6837e5f-139b-4475-8595-1b30d6e4c276 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:22.466457 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d6837e5f-139b-4475-8595-1b30d6e4c276 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:22.467053 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d6837e5f-139b-4475-8595-1b30d6e4c276 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:22.607023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-d6837e5f-139b-4475-8595-1b30d6e4c276 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:22.614613 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-d6837e5f-139b-4475-8595-1b30d6e4c276 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1367 microversion: 2.1 time: 0.162613 Jun 17 08:52:22.615302 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 53/103] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:22 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:22.863289 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d0633e46-dbd8-435d-9684-35ca97725a11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:22.863923 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-d0633e46-dbd8-435d-9684-35ca97725a11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:22.865944 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:22.870734 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d0633e46-dbd8-435d-9684-35ca97725a11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:22.871186 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d0633e46-dbd8-435d-9684-35ca97725a11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:22.871977 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d0633e46-dbd8-435d-9684-35ca97725a11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:22.872415 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d0633e46-dbd8-435d-9684-35ca97725a11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:23.023224 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d0633e46-dbd8-435d-9684-35ca97725a11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:23.034036 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d0633e46-dbd8-435d-9684-35ca97725a11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:23.036242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d0633e46-dbd8-435d-9684-35ca97725a11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:23.037478 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-d0633e46-dbd8-435d-9684-35ca97725a11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1406 microversion: 2.20 time: 0.178035 Jun 17 08:52:23.038561 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 51/104] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:22 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:52:23.086934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-20be066a-9549-4f2a-a12e-a34db1dca09b tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:23.089853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-20be066a-9549-4f2a-a12e-a34db1dca09b tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:23.098421 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-20be066a-9549-4f2a-a12e-a34db1dca09b tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:23.098873 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-20be066a-9549-4f2a-a12e-a34db1dca09b tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:23.099704 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-20be066a-9549-4f2a-a12e-a34db1dca09b tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:23.100134 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-20be066a-9549-4f2a-a12e-a34db1dca09b tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:23.239069 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-20be066a-9549-4f2a-a12e-a34db1dca09b tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:23.247455 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-20be066a-9549-4f2a-a12e-a34db1dca09b tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1315 microversion: 2.1 time: 0.165071 Jun 17 08:52:23.248370 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 54/105] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:23 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:23.630718 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-61648c67-34e5-43c9-8387-ac64446faf7f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:23.631700 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-61648c67-34e5-43c9-8387-ac64446faf7f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:23.638536 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-61648c67-34e5-43c9-8387-ac64446faf7f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:23.639016 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-61648c67-34e5-43c9-8387-ac64446faf7f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:23.639803 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-61648c67-34e5-43c9-8387-ac64446faf7f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:23.640247 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-61648c67-34e5-43c9-8387-ac64446faf7f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:23.774091 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-61648c67-34e5-43c9-8387-ac64446faf7f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:23.781610 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-61648c67-34e5-43c9-8387-ac64446faf7f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1367 microversion: 2.1 time: 0.154648 Jun 17 08:52:23.782216 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 52/106] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:23 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:24.062052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-3505f795-ea68-4c47-97d5-b79f6d38b380 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:24.063520 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-3505f795-ea68-4c47-97d5-b79f6d38b380 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:24.069013 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=2 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:24.076355 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3505f795-ea68-4c47-97d5-b79f6d38b380 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:24.077378 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3505f795-ea68-4c47-97d5-b79f6d38b380 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:24.078914 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3505f795-ea68-4c47-97d5-b79f6d38b380 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:24.079776 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3505f795-ea68-4c47-97d5-b79f6d38b380 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:24.237007 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-3505f795-ea68-4c47-97d5-b79f6d38b380 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:24.244922 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-3505f795-ea68-4c47-97d5-b79f6d38b380 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:24.246513 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-3505f795-ea68-4c47-97d5-b79f6d38b380 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:24.247720 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-3505f795-ea68-4c47-97d5-b79f6d38b380 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1406 microversion: 2.20 time: 0.195834 Jun 17 08:52:24.248276 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 55/107] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:24 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:52:24.264873 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-eb243266-8be5-4e4a-8160-c877bf5e3741 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:24.265493 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-eb243266-8be5-4e4a-8160-c877bf5e3741 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:24.272281 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eb243266-8be5-4e4a-8160-c877bf5e3741 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:24.272735 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eb243266-8be5-4e4a-8160-c877bf5e3741 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:24.273500 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eb243266-8be5-4e4a-8160-c877bf5e3741 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:24.273940 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eb243266-8be5-4e4a-8160-c877bf5e3741 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:24.415034 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-eb243266-8be5-4e4a-8160-c877bf5e3741 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:24.415034 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-eb243266-8be5-4e4a-8160-c877bf5e3741 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1315 microversion: 2.1 time: 0.150585 Jun 17 08:52:24.415034 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 53/108] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:24 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:24.800467 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-490bc753-c544-4530-a319-a31e5c5000bf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:24.800467 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-490bc753-c544-4530-a319-a31e5c5000bf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:24.806822 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-490bc753-c544-4530-a319-a31e5c5000bf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:24.807273 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-490bc753-c544-4530-a319-a31e5c5000bf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:24.808077 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-490bc753-c544-4530-a319-a31e5c5000bf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:24.808517 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-490bc753-c544-4530-a319-a31e5c5000bf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:24.941352 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-490bc753-c544-4530-a319-a31e5c5000bf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:24.956225 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-490bc753-c544-4530-a319-a31e5c5000bf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1367 microversion: 2.1 time: 0.160836 Jun 17 08:52:24.956802 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 56/109] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:24 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:25.266734 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-61a53e28-2fc2-40df-b5ab-bbd542eb4232 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:25.267393 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-61a53e28-2fc2-40df-b5ab-bbd542eb4232 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:25.269239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=2 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:25.274966 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-61a53e28-2fc2-40df-b5ab-bbd542eb4232 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:25.275998 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-61a53e28-2fc2-40df-b5ab-bbd542eb4232 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:25.276205 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-61a53e28-2fc2-40df-b5ab-bbd542eb4232 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:25.276644 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-61a53e28-2fc2-40df-b5ab-bbd542eb4232 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:25.418830 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-61a53e28-2fc2-40df-b5ab-bbd542eb4232 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:25.423644 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-61a53e28-2fc2-40df-b5ab-bbd542eb4232 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:25.425611 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-61a53e28-2fc2-40df-b5ab-bbd542eb4232 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:25.426946 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-61a53e28-2fc2-40df-b5ab-bbd542eb4232 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1406 microversion: 2.20 time: 0.164593 Jun 17 08:52:25.428333 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 54/110] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:25 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:52:25.433304 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-dc992575-ed98-4c65-8e33-0047beb72dc2 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:25.433931 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-dc992575-ed98-4c65-8e33-0047beb72dc2 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:25.441454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dc992575-ed98-4c65-8e33-0047beb72dc2 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:25.441927 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dc992575-ed98-4c65-8e33-0047beb72dc2 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:25.442776 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dc992575-ed98-4c65-8e33-0047beb72dc2 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:25.443951 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dc992575-ed98-4c65-8e33-0047beb72dc2 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:25.594889 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-dc992575-ed98-4c65-8e33-0047beb72dc2 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:25.603256 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-dc992575-ed98-4c65-8e33-0047beb72dc2 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1315 microversion: 2.1 time: 0.177899 Jun 17 08:52:25.603959 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 57/111] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:25 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:25.975536 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-98abfba1-4720-4858-a918-d94ed11de590 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:25.976324 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-98abfba1-4720-4858-a918-d94ed11de590 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:25.984408 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-98abfba1-4720-4858-a918-d94ed11de590 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:25.984868 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-98abfba1-4720-4858-a918-d94ed11de590 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:25.985760 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-98abfba1-4720-4858-a918-d94ed11de590 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:25.986742 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-98abfba1-4720-4858-a918-d94ed11de590 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:26.036019 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-ee97dd5d-b7f0-4e56-8aae-1b1b7b26f966 req-b8e1bb5c-7def-4f13-86bb-72b3dd8bad85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2cc759-7f2e-4308-aaf4-8ac7befa64de", "name": "network-vif-plugged", "status": "completed", "tag": "b089d395-a218-45c9-907d-df2425df186f"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:52:26.056333 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-ee97dd5d-b7f0-4e56-8aae-1b1b7b26f966 req-b8e1bb5c-7def-4f13-86bb-72b3dd8bad85 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:26.056786 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-ee97dd5d-b7f0-4e56-8aae-1b1b7b26f966 req-b8e1bb5c-7def-4f13-86bb-72b3dd8bad85 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:26.073149 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-ee97dd5d-b7f0-4e56-8aae-1b1b7b26f966 req-b8e1bb5c-7def-4f13-86bb-72b3dd8bad85 service nova] Creating event network-vif-plugged:b089d395-a218-45c9-907d-df2425df186f for instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de on hv-cinder-79760 Jun 17 08:52:26.079370 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-ee97dd5d-b7f0-4e56-8aae-1b1b7b26f966 req-b8e1bb5c-7def-4f13-86bb-72b3dd8bad85 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136822 Jun 17 08:52:26.080501 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 55/112] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:52:26.149011 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-98abfba1-4720-4858-a918-d94ed11de590 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:26.156663 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-98abfba1-4720-4858-a918-d94ed11de590 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1367 microversion: 2.1 time: 0.186064 Jun 17 08:52:26.157255 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 58/113] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:25 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:52:26.448885 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-069d774e-8001-4e10-8ca4-0f2e4cffe670 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:26.448885 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-069d774e-8001-4e10-8ca4-0f2e4cffe670 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:26.453579 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-069d774e-8001-4e10-8ca4-0f2e4cffe670 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:26.454175 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-069d774e-8001-4e10-8ca4-0f2e4cffe670 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:26.455111 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-069d774e-8001-4e10-8ca4-0f2e4cffe670 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:26.455296 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-069d774e-8001-4e10-8ca4-0f2e4cffe670 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:26.591517 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-069d774e-8001-4e10-8ca4-0f2e4cffe670 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:26.599399 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-069d774e-8001-4e10-8ca4-0f2e4cffe670 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:26.601524 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-069d774e-8001-4e10-8ca4-0f2e4cffe670 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:26.602625 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-069d774e-8001-4e10-8ca4-0f2e4cffe670 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1406 microversion: 2.20 time: 0.161110 Jun 17 08:52:26.603177 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 56/114] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:26 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:52:26.620890 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-5a22b062-6ddc-4a6a-8604-978046826136 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:26.621508 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-5a22b062-6ddc-4a6a-8604-978046826136 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:26.627555 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5a22b062-6ddc-4a6a-8604-978046826136 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:26.628004 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5a22b062-6ddc-4a6a-8604-978046826136 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:26.628760 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5a22b062-6ddc-4a6a-8604-978046826136 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:26.629192 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5a22b062-6ddc-4a6a-8604-978046826136 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:26.759322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-5a22b062-6ddc-4a6a-8604-978046826136 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:26.766763 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-5a22b062-6ddc-4a6a-8604-978046826136 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1315 microversion: 2.1 time: 0.149679 Jun 17 08:52:26.767330 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 59/115] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:26 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:27.173506 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-b24a9ddf-42f6-4c02-99dc-3ce2d61f749f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:27.174120 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-b24a9ddf-42f6-4c02-99dc-3ce2d61f749f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:27.180392 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b24a9ddf-42f6-4c02-99dc-3ce2d61f749f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:27.180852 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b24a9ddf-42f6-4c02-99dc-3ce2d61f749f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:27.181635 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b24a9ddf-42f6-4c02-99dc-3ce2d61f749f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:27.182059 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b24a9ddf-42f6-4c02-99dc-3ce2d61f749f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:27.321939 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b24a9ddf-42f6-4c02-99dc-3ce2d61f749f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:27.329575 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-b24a9ddf-42f6-4c02-99dc-3ce2d61f749f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1367 microversion: 2.1 time: 0.159883 Jun 17 08:52:27.334171 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 57/116] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:27 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:27.621097 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-3193ff18-c190-427b-8c94-2b8b93490689 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:27.621753 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-3193ff18-c190-427b-8c94-2b8b93490689 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:27.627790 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3193ff18-c190-427b-8c94-2b8b93490689 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:27.628237 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3193ff18-c190-427b-8c94-2b8b93490689 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:27.628995 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3193ff18-c190-427b-8c94-2b8b93490689 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:27.629425 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3193ff18-c190-427b-8c94-2b8b93490689 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:27.758322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-3193ff18-c190-427b-8c94-2b8b93490689 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:27.766260 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-3193ff18-c190-427b-8c94-2b8b93490689 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:27.767793 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-3193ff18-c190-427b-8c94-2b8b93490689 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:27.768937 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-3193ff18-c190-427b-8c94-2b8b93490689 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1406 microversion: 2.20 time: 0.151846 Jun 17 08:52:27.769479 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 60/117] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:27 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:52:27.784128 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-26e342d0-9670-4383-947c-9a29bbcd6a86 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:27.784745 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-26e342d0-9670-4383-947c-9a29bbcd6a86 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:27.791619 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-26e342d0-9670-4383-947c-9a29bbcd6a86 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:27.792080 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-26e342d0-9670-4383-947c-9a29bbcd6a86 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:27.792860 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-26e342d0-9670-4383-947c-9a29bbcd6a86 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:27.793309 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-26e342d0-9670-4383-947c-9a29bbcd6a86 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:27.924662 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-26e342d0-9670-4383-947c-9a29bbcd6a86 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:27.932775 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-26e342d0-9670-4383-947c-9a29bbcd6a86 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1315 microversion: 2.1 time: 0.152530 Jun 17 08:52:27.933357 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 58/118] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:27 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:28.350784 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-44d66ab2-2c83-47b5-9d8d-d06a904bcc61 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:28.352341 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-44d66ab2-2c83-47b5-9d8d-d06a904bcc61 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:28.360527 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-44d66ab2-2c83-47b5-9d8d-d06a904bcc61 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:28.361986 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-44d66ab2-2c83-47b5-9d8d-d06a904bcc61 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:28.363864 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-44d66ab2-2c83-47b5-9d8d-d06a904bcc61 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:28.364660 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-44d66ab2-2c83-47b5-9d8d-d06a904bcc61 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:28.566016 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-44d66ab2-2c83-47b5-9d8d-d06a904bcc61 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:28.575319 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-44d66ab2-2c83-47b5-9d8d-d06a904bcc61 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1367 microversion: 2.1 time: 0.229709 Jun 17 08:52:28.575942 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 61/119] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:28 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:52:28.786244 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-8ddf798e-d370-4010-9407-34b67628a8b5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:28.786853 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-8ddf798e-d370-4010-9407-34b67628a8b5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:28.793074 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8ddf798e-d370-4010-9407-34b67628a8b5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:28.793523 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8ddf798e-d370-4010-9407-34b67628a8b5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:28.794349 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8ddf798e-d370-4010-9407-34b67628a8b5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:28.794783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8ddf798e-d370-4010-9407-34b67628a8b5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:28.923047 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-8ddf798e-d370-4010-9407-34b67628a8b5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:28.931656 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-8ddf798e-d370-4010-9407-34b67628a8b5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:28.933082 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-8ddf798e-d370-4010-9407-34b67628a8b5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:28.934175 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-8ddf798e-d370-4010-9407-34b67628a8b5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1406 microversion: 2.20 time: 0.151932 Jun 17 08:52:28.934744 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 59/120] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:28 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:52:28.950467 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-6a3153fd-cf30-41d2-be21-c540eb95de92 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:28.951088 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-6a3153fd-cf30-41d2-be21-c540eb95de92 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:28.957200 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6a3153fd-cf30-41d2-be21-c540eb95de92 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:28.957666 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6a3153fd-cf30-41d2-be21-c540eb95de92 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:28.958439 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6a3153fd-cf30-41d2-be21-c540eb95de92 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:28.958904 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6a3153fd-cf30-41d2-be21-c540eb95de92 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:29.096356 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-6a3153fd-cf30-41d2-be21-c540eb95de92 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:29.103984 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-6a3153fd-cf30-41d2-be21-c540eb95de92 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1315 microversion: 2.1 time: 0.157362 Jun 17 08:52:29.104559 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 62/121] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:28 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:29.593755 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-afd89e99-43f3-4407-88da-ab7c40dfb78e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:29.594376 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-afd89e99-43f3-4407-88da-ab7c40dfb78e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:29.600958 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-afd89e99-43f3-4407-88da-ab7c40dfb78e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:29.601503 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-afd89e99-43f3-4407-88da-ab7c40dfb78e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:29.602398 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-afd89e99-43f3-4407-88da-ab7c40dfb78e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:29.602846 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-afd89e99-43f3-4407-88da-ab7c40dfb78e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:29.752718 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-afd89e99-43f3-4407-88da-ab7c40dfb78e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:29.760195 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-afd89e99-43f3-4407-88da-ab7c40dfb78e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1367 microversion: 2.1 time: 0.170317 Jun 17 08:52:29.760766 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 60/122] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:29 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:29.954331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-c4c5155a-ce90-49a1-8fe3-90055dee41f0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:29.954958 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-c4c5155a-ce90-49a1-8fe3-90055dee41f0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:29.961035 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c4c5155a-ce90-49a1-8fe3-90055dee41f0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:29.961552 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c4c5155a-ce90-49a1-8fe3-90055dee41f0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:29.963146 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c4c5155a-ce90-49a1-8fe3-90055dee41f0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:29.965941 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c4c5155a-ce90-49a1-8fe3-90055dee41f0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:30.120978 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a47011b8-fd53-4bb0-92fa-e4600bb0189f tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:30.122174 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-a47011b8-fd53-4bb0-92fa-e4600bb0189f tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:30.128347 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a47011b8-fd53-4bb0-92fa-e4600bb0189f tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:30.128699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a47011b8-fd53-4bb0-92fa-e4600bb0189f tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:30.129620 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a47011b8-fd53-4bb0-92fa-e4600bb0189f tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:30.129995 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c4c5155a-ce90-49a1-8fe3-90055dee41f0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:30.130119 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a47011b8-fd53-4bb0-92fa-e4600bb0189f tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:30.133932 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=100 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:30.139140 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c4c5155a-ce90-49a1-8fe3-90055dee41f0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:30.148115 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c4c5155a-ce90-49a1-8fe3-90055dee41f0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:30.154179 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-c4c5155a-ce90-49a1-8fe3-90055dee41f0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1406 microversion: 2.20 time: 0.204971 Jun 17 08:52:30.154773 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 63/123] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:29 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:52:30.297955 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-60ce09cd-d356-418f-a9f4-c6a9c3105619 req-05fba259-56e1-41f6-8e78-3640862d6b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42469758-d2b8-4bde-92f6-0b7ef5528fbc", "name": "network-vif-plugged", "status": "completed", "tag": "62eb07ca-d310-44bf-a6bd-62e5e42d4403"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:52:30.309018 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a47011b8-fd53-4bb0-92fa-e4600bb0189f tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:30.311967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-60ce09cd-d356-418f-a9f4-c6a9c3105619 req-05fba259-56e1-41f6-8e78-3640862d6b11 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:30.312559 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-60ce09cd-d356-418f-a9f4-c6a9c3105619 req-05fba259-56e1-41f6-8e78-3640862d6b11 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:30.316545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-a47011b8-fd53-4bb0-92fa-e4600bb0189f tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1315 microversion: 2.1 time: 0.199361 Jun 17 08:52:30.317302 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 61/124] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:30 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:30.328916 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-60ce09cd-d356-418f-a9f4-c6a9c3105619 req-05fba259-56e1-41f6-8e78-3640862d6b11 service nova] Creating event network-vif-plugged:62eb07ca-d310-44bf-a6bd-62e5e42d4403 for instance 42469758-d2b8-4bde-92f6-0b7ef5528fbc on hv-cinder-79760 Jun 17 08:52:30.335293 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-60ce09cd-d356-418f-a9f4-c6a9c3105619 req-05fba259-56e1-41f6-8e78-3640862d6b11 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040114 Jun 17 08:52:30.336001 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 64/125] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:52:30.785434 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-9f098db2-968b-4219-8084-3eec586ee683 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:30.789040 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-9f098db2-968b-4219-8084-3eec586ee683 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:30.802724 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9f098db2-968b-4219-8084-3eec586ee683 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:30.803554 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9f098db2-968b-4219-8084-3eec586ee683 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:30.804979 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9f098db2-968b-4219-8084-3eec586ee683 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:30.806897 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9f098db2-968b-4219-8084-3eec586ee683 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:31.049379 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-9f098db2-968b-4219-8084-3eec586ee683 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:31.058415 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-9f098db2-968b-4219-8084-3eec586ee683 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1367 microversion: 2.1 time: 0.282565 Jun 17 08:52:31.059016 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 62/126] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:30 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:31.173262 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-fe2b49f5-6532-45eb-b23c-df47b8b06c88 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:31.174519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-fe2b49f5-6532-45eb-b23c-df47b8b06c88 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:31.181467 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fe2b49f5-6532-45eb-b23c-df47b8b06c88 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:31.181929 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fe2b49f5-6532-45eb-b23c-df47b8b06c88 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:31.182711 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fe2b49f5-6532-45eb-b23c-df47b8b06c88 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:31.183319 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fe2b49f5-6532-45eb-b23c-df47b8b06c88 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:31.334752 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-64c10ea3-e3dd-4007-b0a4-bfad2f0a9dc8 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:31.335477 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-64c10ea3-e3dd-4007-b0a4-bfad2f0a9dc8 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:31.343013 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-64c10ea3-e3dd-4007-b0a4-bfad2f0a9dc8 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:31.343506 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-fe2b49f5-6532-45eb-b23c-df47b8b06c88 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:31.343720 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-64c10ea3-e3dd-4007-b0a4-bfad2f0a9dc8 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:31.344637 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-64c10ea3-e3dd-4007-b0a4-bfad2f0a9dc8 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:31.345215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-64c10ea3-e3dd-4007-b0a4-bfad2f0a9dc8 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:31.352165 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-fe2b49f5-6532-45eb-b23c-df47b8b06c88 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:31.354364 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-fe2b49f5-6532-45eb-b23c-df47b8b06c88 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:31.356026 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-fe2b49f5-6532-45eb-b23c-df47b8b06c88 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1406 microversion: 2.20 time: 0.186878 Jun 17 08:52:31.356866 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 65/127] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:31 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:52:31.485589 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-64c10ea3-e3dd-4007-b0a4-bfad2f0a9dc8 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:31.493946 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-64c10ea3-e3dd-4007-b0a4-bfad2f0a9dc8 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1503 microversion: 2.1 time: 0.163716 Jun 17 08:52:31.505394 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 63/128] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:31 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:52:32.077269 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-91cd9bd2-75b3-4c25-9263-a39837e080fc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:32.077910 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-91cd9bd2-75b3-4c25-9263-a39837e080fc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:32.084043 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-91cd9bd2-75b3-4c25-9263-a39837e080fc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:32.084519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-91cd9bd2-75b3-4c25-9263-a39837e080fc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:32.090360 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-91cd9bd2-75b3-4c25-9263-a39837e080fc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:32.090360 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-91cd9bd2-75b3-4c25-9263-a39837e080fc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:32.278865 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-91cd9bd2-75b3-4c25-9263-a39837e080fc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:32.286537 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-91cd9bd2-75b3-4c25-9263-a39837e080fc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1367 microversion: 2.1 time: 0.213038 Jun 17 08:52:32.287298 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 66/129] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:32 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:32.350544 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-e645ae5b-dec1-4a81-b449-690590b92ffa req-0de7e4cb-0450-43c2-b272-e6bbdd6f6a07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397d996b-b163-4a47-856e-f2aca2ae6976", "name": "network-vif-plugged", "status": "completed", "tag": "051f4b45-cbb1-44c1-92a3-54becef75c28"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:52:32.359453 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-e645ae5b-dec1-4a81-b449-690590b92ffa req-0de7e4cb-0450-43c2-b272-e6bbdd6f6a07 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:32.359898 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-e645ae5b-dec1-4a81-b449-690590b92ffa req-0de7e4cb-0450-43c2-b272-e6bbdd6f6a07 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:32.372097 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-e645ae5b-dec1-4a81-b449-690590b92ffa req-0de7e4cb-0450-43c2-b272-e6bbdd6f6a07 service nova] Creating event network-vif-plugged:051f4b45-cbb1-44c1-92a3-54becef75c28 for instance 397d996b-b163-4a47-856e-f2aca2ae6976 on hv-cinder-79760 Jun 17 08:52:32.375029 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-f8763472-6f65-46fb-bac6-355571cf0169 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:32.376905 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-f8763472-6f65-46fb-bac6-355571cf0169 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:32.382505 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-e645ae5b-dec1-4a81-b449-690590b92ffa req-0de7e4cb-0450-43c2-b272-e6bbdd6f6a07 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030977 Jun 17 08:52:32.382505 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 64/130] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:52:32.390734 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f8763472-6f65-46fb-bac6-355571cf0169 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:32.391185 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f8763472-6f65-46fb-bac6-355571cf0169 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:32.391977 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f8763472-6f65-46fb-bac6-355571cf0169 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:32.392605 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f8763472-6f65-46fb-bac6-355571cf0169 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:32.565277 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-f8763472-6f65-46fb-bac6-355571cf0169 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:32.574222 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-f8763472-6f65-46fb-bac6-355571cf0169 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:32.575943 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-f8763472-6f65-46fb-bac6-355571cf0169 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:32.577176 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-f8763472-6f65-46fb-bac6-355571cf0169 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1406 microversion: 2.20 time: 0.206267 Jun 17 08:52:32.577765 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 67/131] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:32 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:52:33.304677 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-9021f514-42cf-4bc0-9362-929cfef44aa5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:33.305461 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-9021f514-42cf-4bc0-9362-929cfef44aa5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:33.313070 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9021f514-42cf-4bc0-9362-929cfef44aa5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:33.313526 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9021f514-42cf-4bc0-9362-929cfef44aa5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:33.314303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9021f514-42cf-4bc0-9362-929cfef44aa5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:33.314747 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9021f514-42cf-4bc0-9362-929cfef44aa5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:33.318939 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=100 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:33.464204 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-9021f514-42cf-4bc0-9362-929cfef44aa5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:33.471766 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-9021f514-42cf-4bc0-9362-929cfef44aa5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1367 microversion: 2.1 time: 0.171232 Jun 17 08:52:33.472372 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 65/132] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:33 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:33.605625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-0220dc10-dce6-4088-848e-d2ace3e89158 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:33.605625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-0220dc10-dce6-4088-848e-d2ace3e89158 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:33.605625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0220dc10-dce6-4088-848e-d2ace3e89158 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:33.607330 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0220dc10-dce6-4088-848e-d2ace3e89158 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:33.608360 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0220dc10-dce6-4088-848e-d2ace3e89158 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:33.608953 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0220dc10-dce6-4088-848e-d2ace3e89158 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:33.792220 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-0220dc10-dce6-4088-848e-d2ace3e89158 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:33.800053 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-0220dc10-dce6-4088-848e-d2ace3e89158 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:33.802059 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-0220dc10-dce6-4088-848e-d2ace3e89158 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:33.803612 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-0220dc10-dce6-4088-848e-d2ace3e89158 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1406 microversion: 2.20 time: 0.211120 Jun 17 08:52:33.807400 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 68/133] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:33 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:52:34.123270 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-2bf90b75-e44a-4bea-a06d-8bf53033fd04 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f370b518-1ffa-452f-9db7-8731bb1071b1"}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:52:34.124514 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-2bf90b75-e44a-4bea-a06d-8bf53033fd04 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:34.130578 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2bf90b75-e44a-4bea-a06d-8bf53033fd04 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:34.131029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2bf90b75-e44a-4bea-a06d-8bf53033fd04 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:34.131842 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2bf90b75-e44a-4bea-a06d-8bf53033fd04 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:34.132278 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2bf90b75-e44a-4bea-a06d-8bf53033fd04 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:34.489311 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-f2391c91-adfc-4d4b-8f8b-bb8d4c49b4de tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:34.489928 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-f2391c91-adfc-4d4b-8f8b-bb8d4c49b4de tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:34.496154 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f2391c91-adfc-4d4b-8f8b-bb8d4c49b4de tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:34.496606 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f2391c91-adfc-4d4b-8f8b-bb8d4c49b4de tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:34.497367 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f2391c91-adfc-4d4b-8f8b-bb8d4c49b4de tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:34.497806 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f2391c91-adfc-4d4b-8f8b-bb8d4c49b4de tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:34.652447 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-f2391c91-adfc-4d4b-8f8b-bb8d4c49b4de tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:34.659995 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-f2391c91-adfc-4d4b-8f8b-bb8d4c49b4de tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1367 microversion: 2.1 time: 0.174564 Jun 17 08:52:34.661285 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 69/134] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:34 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:52:34.825805 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-33ac1b3d-045e-4e60-882c-b6ba5a5d7d4c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:34.826564 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-33ac1b3d-045e-4e60-882c-b6ba5a5d7d4c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:34.833102 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-33ac1b3d-045e-4e60-882c-b6ba5a5d7d4c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:34.837313 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-33ac1b3d-045e-4e60-882c-b6ba5a5d7d4c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:34.837313 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-33ac1b3d-045e-4e60-882c-b6ba5a5d7d4c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:34.837313 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-33ac1b3d-045e-4e60-882c-b6ba5a5d7d4c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:35.017527 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-33ac1b3d-045e-4e60-882c-b6ba5a5d7d4c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:35.028410 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-33ac1b3d-045e-4e60-882c-b6ba5a5d7d4c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:35.030108 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-33ac1b3d-045e-4e60-882c-b6ba5a5d7d4c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:35.031567 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-33ac1b3d-045e-4e60-882c-b6ba5a5d7d4c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1406 microversion: 2.20 time: 0.212419 Jun 17 08:52:35.032185 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 70/135] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:34 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:52:35.678227 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-1cf3a314-e20c-4e29-a7a9-c66d84e50171 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:35.678963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-1cf3a314-e20c-4e29-a7a9-c66d84e50171 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:35.686541 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1cf3a314-e20c-4e29-a7a9-c66d84e50171 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:35.687171 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1cf3a314-e20c-4e29-a7a9-c66d84e50171 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:35.688044 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1cf3a314-e20c-4e29-a7a9-c66d84e50171 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:35.688554 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1cf3a314-e20c-4e29-a7a9-c66d84e50171 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:35.860689 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-1cf3a314-e20c-4e29-a7a9-c66d84e50171 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:35.869847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-1cf3a314-e20c-4e29-a7a9-c66d84e50171 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1557 microversion: 2.1 time: 0.195524 Jun 17 08:52:35.870606 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 71/136] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:35 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1557 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:52:35.893568 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-66089af2-f230-47fa-85ce-9c76bd1e1066 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:35.894074 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-66089af2-f230-47fa-85ce-9c76bd1e1066 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:35.900106 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-66089af2-f230-47fa-85ce-9c76bd1e1066 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:35.900562 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-66089af2-f230-47fa-85ce-9c76bd1e1066 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:35.901327 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-66089af2-f230-47fa-85ce-9c76bd1e1066 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:35.901755 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-66089af2-f230-47fa-85ce-9c76bd1e1066 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:36.124132 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-66089af2-f230-47fa-85ce-9c76bd1e1066 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.234398 Jun 17 08:52:36.124771 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 72/137] 10.222.0.78 () {58 vars in 1274 bytes} [Fri Jun 17 08:52:35 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc/os-interface => generated 285 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:52:36.136453 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-f4e30704-1bec-4d27-987f-dbb45b53ab9a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:36.136453 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-f4e30704-1bec-4d27-987f-dbb45b53ab9a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:36.143329 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f4e30704-1bec-4d27-987f-dbb45b53ab9a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:36.144107 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f4e30704-1bec-4d27-987f-dbb45b53ab9a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:36.145160 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f4e30704-1bec-4d27-987f-dbb45b53ab9a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:36.145793 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f4e30704-1bec-4d27-987f-dbb45b53ab9a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:36.358157 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-f4e30704-1bec-4d27-987f-dbb45b53ab9a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:36.375821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-f4e30704-1bec-4d27-987f-dbb45b53ab9a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:36.380100 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-f4e30704-1bec-4d27-987f-dbb45b53ab9a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:36.382000 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-f4e30704-1bec-4d27-987f-dbb45b53ab9a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1599 microversion: 2.20 time: 0.249564 Jun 17 08:52:36.386501 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 73/138] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:36 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1599 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:52:36.406691 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-dc5f99dd-4e5f-4b7f-9d1a-79f00fde997b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:36.407666 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-dc5f99dd-4e5f-4b7f-9d1a-79f00fde997b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:36.414251 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dc5f99dd-4e5f-4b7f-9d1a-79f00fde997b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:36.415880 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dc5f99dd-4e5f-4b7f-9d1a-79f00fde997b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:36.416793 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dc5f99dd-4e5f-4b7f-9d1a-79f00fde997b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:36.417236 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dc5f99dd-4e5f-4b7f-9d1a-79f00fde997b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:36.523706 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-dc5f99dd-4e5f-4b7f-9d1a-79f00fde997b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.119059 Jun 17 08:52:36.533473 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 74/139] 10.222.0.78 () {60 vars in 1315 bytes} [Fri Jun 17 08:52:36 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976/os-interface => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 08:52:36.786257 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-2bf90b75-e44a-4bea-a06d-8bf53033fd04 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "POST /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.666641 Jun 17 08:52:36.793671 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 66/140] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jun 17 08:52:34 2022] POST /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de/os-volume_attachments => generated 194 bytes in 2675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:52:37.888828 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-bdef27bb-f8ef-439d-b142-2e4263151761 req-4021d1b0-9c9d-4fe8-b3a4-670b31cb0136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42469758-d2b8-4bde-92f6-0b7ef5528fbc", "tag": "62eb07ca-d310-44bf-a6bd-62e5e42d4403"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:52:37.899548 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-bdef27bb-f8ef-439d-b142-2e4263151761 req-4021d1b0-9c9d-4fe8-b3a4-670b31cb0136 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:37.900914 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-bdef27bb-f8ef-439d-b142-2e4263151761 req-4021d1b0-9c9d-4fe8-b3a4-670b31cb0136 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:37.918179 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-bdef27bb-f8ef-439d-b142-2e4263151761 req-4021d1b0-9c9d-4fe8-b3a4-670b31cb0136 service nova] Creating event network-changed:62eb07ca-d310-44bf-a6bd-62e5e42d4403 for instance 42469758-d2b8-4bde-92f6-0b7ef5528fbc on hv-cinder-79760 Jun 17 08:52:37.923778 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-bdef27bb-f8ef-439d-b142-2e4263151761 req-4021d1b0-9c9d-4fe8-b3a4-670b31cb0136 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039661 Jun 17 08:52:37.939233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 75/141] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:52:38.309772 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-f1f1949e-1612-47d4-be8d-fda317050c00 req-8e5c9d4f-bffc-4c5e-a47e-539abf2f40e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "397d996b-b163-4a47-856e-f2aca2ae6976", "tag": "051f4b45-cbb1-44c1-92a3-54becef75c28"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:52:38.318498 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-f1f1949e-1612-47d4-be8d-fda317050c00 req-8e5c9d4f-bffc-4c5e-a47e-539abf2f40e5 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:38.318955 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-f1f1949e-1612-47d4-be8d-fda317050c00 req-8e5c9d4f-bffc-4c5e-a47e-539abf2f40e5 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:38.331220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-f1f1949e-1612-47d4-be8d-fda317050c00 req-8e5c9d4f-bffc-4c5e-a47e-539abf2f40e5 service nova] Creating event network-changed:051f4b45-cbb1-44c1-92a3-54becef75c28 for instance 397d996b-b163-4a47-856e-f2aca2ae6976 on hv-cinder-79760 Jun 17 08:52:38.336736 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-f1f1949e-1612-47d4-be8d-fda317050c00 req-8e5c9d4f-bffc-4c5e-a47e-539abf2f40e5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032082 Jun 17 08:52:38.338075 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 67/142] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:52:49.964807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_api:SELECT=48 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:49.965595 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=60 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:49.969683 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-5bf82357-4e15-4838-a64b-10712f665a94 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:49.970279 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-5bf82357-4e15-4838-a64b-10712f665a94 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:49.977410 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5bf82357-4e15-4838-a64b-10712f665a94 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:49.977861 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5bf82357-4e15-4838-a64b-10712f665a94 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:49.979536 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5bf82357-4e15-4838-a64b-10712f665a94 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:49.980099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5bf82357-4e15-4838-a64b-10712f665a94 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:50.009210 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-5bf82357-4e15-4838-a64b-10712f665a94 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Going to try to terminate instance {{(pid=129876) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:52:50.357093 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-5bf82357-4e15-4838-a64b-10712f665a94 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 204 len: 0 microversion: 2.1 time: 0.392843 Jun 17 08:52:50.357738 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 76/143] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 08:52:49 2022] DELETE /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:52:50.363834 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=33 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:50.364721 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:50.368813 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-6a14764c-3578-4783-8a2f-c895a4229ea9 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:50.369561 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-6a14764c-3578-4783-8a2f-c895a4229ea9 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:50.376822 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6a14764c-3578-4783-8a2f-c895a4229ea9 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:50.377322 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6a14764c-3578-4783-8a2f-c895a4229ea9 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:50.378276 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6a14764c-3578-4783-8a2f-c895a4229ea9 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:50.378872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6a14764c-3578-4783-8a2f-c895a4229ea9 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:50.526712 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-6a14764c-3578-4783-8a2f-c895a4229ea9 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:50.534915 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-6a14764c-3578-4783-8a2f-c895a4229ea9 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1555 microversion: 2.1 time: 0.172729 Jun 17 08:52:50.535892 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 68/144] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:50 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:51.556027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-23005f5c-0e39-41d3-aac1-16f0856ce449 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:51.557566 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-23005f5c-0e39-41d3-aac1-16f0856ce449 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:51.564802 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-23005f5c-0e39-41d3-aac1-16f0856ce449 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:51.565250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-23005f5c-0e39-41d3-aac1-16f0856ce449 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:51.566079 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-23005f5c-0e39-41d3-aac1-16f0856ce449 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:51.566509 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-23005f5c-0e39-41d3-aac1-16f0856ce449 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:51.740672 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-23005f5c-0e39-41d3-aac1-16f0856ce449 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:51.749826 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-23005f5c-0e39-41d3-aac1-16f0856ce449 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1555 microversion: 2.1 time: 0.198336 Jun 17 08:52:51.760005 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 77/145] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:51 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1555 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:52.768018 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-923168d7-537e-43f9-8023-fb10663c2733 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:52.768018 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-923168d7-537e-43f9-8023-fb10663c2733 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:52.775688 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-923168d7-537e-43f9-8023-fb10663c2733 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:52.776132 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-923168d7-537e-43f9-8023-fb10663c2733 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:52.776901 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-923168d7-537e-43f9-8023-fb10663c2733 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:52.777496 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-923168d7-537e-43f9-8023-fb10663c2733 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:52.939640 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-923168d7-537e-43f9-8023-fb10663c2733 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:52.947702 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-923168d7-537e-43f9-8023-fb10663c2733 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1555 microversion: 2.1 time: 0.184225 Jun 17 08:52:52.951844 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 69/146] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:52 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1555 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:53.967127 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-70d42075-c17a-4feb-903f-9661716f498e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:53.967950 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-70d42075-c17a-4feb-903f-9661716f498e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:53.974706 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-70d42075-c17a-4feb-903f-9661716f498e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:53.975170 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-70d42075-c17a-4feb-903f-9661716f498e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:53.978822 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-70d42075-c17a-4feb-903f-9661716f498e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:53.979154 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-70d42075-c17a-4feb-903f-9661716f498e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:54.131158 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-70d42075-c17a-4feb-903f-9661716f498e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:54.140892 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-70d42075-c17a-4feb-903f-9661716f498e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1555 microversion: 2.1 time: 0.177582 Jun 17 08:52:54.141501 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 78/147] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:53 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:55.158824 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-7e8a790c-ef84-44b0-ab76-6eaaecec8250 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:55.162174 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-7e8a790c-ef84-44b0-ab76-6eaaecec8250 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:55.168108 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7e8a790c-ef84-44b0-ab76-6eaaecec8250 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:55.168757 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7e8a790c-ef84-44b0-ab76-6eaaecec8250 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:55.169703 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7e8a790c-ef84-44b0-ab76-6eaaecec8250 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:55.170292 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7e8a790c-ef84-44b0-ab76-6eaaecec8250 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:55.250762 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-6a0f7845-01fc-4d35-92ef-a6edb10d7b37 req-9871103f-8278-4080-9f3b-8648035d3191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2cc759-7f2e-4308-aaf4-8ac7befa64de", "name": "network-vif-deleted", "tag": "b089d395-a218-45c9-907d-df2425df186f"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:52:55.270747 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-6a0f7845-01fc-4d35-92ef-a6edb10d7b37 req-9871103f-8278-4080-9f3b-8648035d3191 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:55.270747 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-6a0f7845-01fc-4d35-92ef-a6edb10d7b37 req-9871103f-8278-4080-9f3b-8648035d3191 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:55.278300 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-7e8a790c-ef84-44b0-ab76-6eaaecec8250 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:55.284030 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-6a0f7845-01fc-4d35-92ef-a6edb10d7b37 req-9871103f-8278-4080-9f3b-8648035d3191 service nova] Creating event network-vif-deleted:b089d395-a218-45c9-907d-df2425df186f for instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de on hv-cinder-79760 Jun 17 08:52:55.287100 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-7e8a790c-ef84-44b0-ab76-6eaaecec8250 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1513 microversion: 2.1 time: 0.132943 Jun 17 08:52:55.298222 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 70/148] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:55 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1513 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:55.304189 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-6a0f7845-01fc-4d35-92ef-a6edb10d7b37 req-9871103f-8278-4080-9f3b-8648035d3191 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058908 Jun 17 08:52:55.310837 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 79/149] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:52:56.305355 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0a5935f7-e214-4017-a60e-68e197861d8b tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:56.306739 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0a5935f7-e214-4017-a60e-68e197861d8b tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:56.314233 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0a5935f7-e214-4017-a60e-68e197861d8b tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:56.316564 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0a5935f7-e214-4017-a60e-68e197861d8b tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:56.316564 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0a5935f7-e214-4017-a60e-68e197861d8b tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:56.316564 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0a5935f7-e214-4017-a60e-68e197861d8b tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:56.416956 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0a5935f7-e214-4017-a60e-68e197861d8b tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e4c92b149c4dffbdeba414d8803bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63675a395d824db687bca143dc25c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:56.429556 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0a5935f7-e214-4017-a60e-68e197861d8b tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 200 len: 1346 microversion: 2.1 time: 0.128467 Jun 17 08:52:56.458342 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 71/150] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:56 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 1346 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:57.480576 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-27aa119c-ed23-42a7-8b35-0b23a93cf05e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:57.481422 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-27aa119c-ed23-42a7-8b35-0b23a93cf05e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:57.492200 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-27aa119c-ed23-42a7-8b35-0b23a93cf05e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:57.495668 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-27aa119c-ed23-42a7-8b35-0b23a93cf05e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:57.496731 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-27aa119c-ed23-42a7-8b35-0b23a93cf05e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:57.497454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-27aa119c-ed23-42a7-8b35-0b23a93cf05e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:57.528474 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-27aa119c-ed23-42a7-8b35-0b23a93cf05e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] HTTP exception thrown: Instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de could not be found. Jun 17 08:52:57.539881 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-27aa119c-ed23-42a7-8b35-0b23a93cf05e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Request method failure captured: Jun 17 08:52:57.539881 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de HTTP/1.1 Jun 17 08:52:57.539881 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:52:57.539881 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:52:57.539881 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:52:57.539881 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 08:52:57.539881 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:52:57.539881 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:52:57.539881 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:52:57.539881 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:52:57.539881 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirECrIRWepm9QwywmPxl6a8Cd6CUxvQsmznyE4pMpx3CmIzJC67VNTkSiUiLu59ASxWrI-8qd6zMQC3vL8093TXtLVs62Cy6JfchmmEjVwXABYkg6B9gAChlahGkmYkBfXhohrgXEJFoTtmsW7FMPeNUkDhi9a2eP7rH8LjdRc4w5-50 Jun 17 08:52:57.539881 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:52:57.539881 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:52:57.539881 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:52:57.539881 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:52:57.539881 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:52:57.539881 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:52:57.539881 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: 63675a395d824db687bca143dc25c3b2 Jun 17 08:52:57.539881 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-DeleteServersTestJSON-603884224 Jun 17 08:52:57.539881 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:52:57.539881 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:52:57.541920 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/63675a395d824db687bca143dc25c3b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/63675a395d824db687bca143dc25c3b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_63675a395d824db687bca143dc25c3b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/63675a395d824db687bca143dc25c3b2"}]}] Jun 17 08:52:57.541920 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-DeleteServersTestJSON-603884224 Jun 17 08:52:57.541920 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: 63675a395d824db687bca143dc25c3b2 Jun 17 08:52:57.541920 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-DeleteServersTestJSON-603884224 Jun 17 08:52:57.541920 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-DeleteServersTestJSON-603884224-project Jun 17 08:52:57.541920 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:52:57.541920 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:52:57.541920 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: 72e4c92b149c4dffbdeba414d8803bf8 Jun 17 08:52:57.541920 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-DeleteServersTestJSON-603884224-project Jun 17 08:52:57.541920 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 08:52:57.541920 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de could not be found. Jun 17 08:52:57.541920 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'id': '6a2cc759-7f2e-4308-aaf4-8ac7befa64de'} Jun 17 08:52:57.543385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:52:57.543385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:57.543385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:52:57.543385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:52:57.543385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:52:57.543385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:52:57.543385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:52:57.543385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:52:57.543385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:52:57.543385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:52:57.543385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de could not be found. Jun 17 08:52:57.543385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:57.543385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:57.543385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:57.543385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:57.543385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:57.543385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:57.543385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:52:57.543385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:52:57.543385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:52:57.544863 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:52:57.544863 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:52:57.544863 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:52:57.544863 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:52:57.544863 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:52:57.544863 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:52:57.544863 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:52:57.544863 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de could not be found. Jun 17 08:52:57.544863 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:57.544863 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:57.544863 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:57.544863 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:57.544863 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:57.544863 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:57.544863 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:52:57.544863 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:52:57.544863 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de could not be found. Jun 17 08:52:57.544863 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:52:57.546084 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-27aa119c-ed23-42a7-8b35-0b23a93cf05e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Returning 404 to user: Instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de could not be found. {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:52:57.546084 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-27aa119c-ed23-42a7-8b35-0b23a93cf05e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 404 len: 111 microversion: 2.1 time: 0.069155 Jun 17 08:52:57.546084 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 80/151] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:57 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:52:57.679470 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-66149e78-542b-4ec2-9969-972983e572d0 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:57.680940 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-66149e78-542b-4ec2-9969-972983e572d0 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:57.693855 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-66149e78-542b-4ec2-9969-972983e572d0 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:57.693855 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-66149e78-542b-4ec2-9969-972983e572d0 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:57.693855 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-66149e78-542b-4ec2-9969-972983e572d0 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:57.693855 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-66149e78-542b-4ec2-9969-972983e572d0 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:57.706420 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-66149e78-542b-4ec2-9969-972983e572d0 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] HTTP exception thrown: Instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de could not be found. Jun 17 08:52:57.711480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-66149e78-542b-4ec2-9969-972983e572d0 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Request method failure captured: Jun 17 08:52:57.711480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de/os-volume_attachments HTTP/1.1 Jun 17 08:52:57.711480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 08:52:57.711480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 08:52:57.711480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 08:52:57.711480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 08:52:57.711480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 08:52:57.711480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 08:52:57.711480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 08:52:57.711480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 08:52:57.711480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirECrIRWepm9QwywmPxl6a8Cd6CUxvQsmznyE4pMpx3CmIzJC67VNTkSiUiLu59ASxWrI-8qd6zMQC3vL8093TXtLVs62Cy6JfchmmEjVwXABYkg6B9gAChlahGkmYkBfXhohrgXEJFoTtmsW7FMPeNUkDhi9a2eP7rH8LjdRc4w5-50 Jun 17 08:52:57.711480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 08:52:57.711480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 08:52:57.711480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 08:52:57.711480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 08:52:57.711480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 08:52:57.711480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 08:52:57.711480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: 63675a395d824db687bca143dc25c3b2 Jun 17 08:52:57.711480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-DeleteServersTestJSON-603884224 Jun 17 08:52:57.711480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 08:52:57.711480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 08:52:57.713423 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/63675a395d824db687bca143dc25c3b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/63675a395d824db687bca143dc25c3b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_63675a395d824db687bca143dc25c3b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/63675a395d824db687bca143dc25c3b2"}]}] Jun 17 08:52:57.713423 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-DeleteServersTestJSON-603884224 Jun 17 08:52:57.713423 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: 63675a395d824db687bca143dc25c3b2 Jun 17 08:52:57.713423 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-DeleteServersTestJSON-603884224 Jun 17 08:52:57.713423 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-DeleteServersTestJSON-603884224-project Jun 17 08:52:57.713423 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 08:52:57.713423 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 08:52:57.713423 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: 72e4c92b149c4dffbdeba414d8803bf8 Jun 17 08:52:57.713423 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-DeleteServersTestJSON-603884224-project Jun 17 08:52:57.713423 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: > Jun 17 08:52:57.713423 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de could not be found. Jun 17 08:52:57.713423 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'server_id': '6a2cc759-7f2e-4308-aaf4-8ac7befa64de'} Jun 17 08:52:57.714242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:52:57.714242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:57.714242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:52:57.714242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:52:57.714242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:52:57.714242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:52:57.714242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:52:57.714242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:52:57.714242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:52:57.714242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:52:57.714242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de could not be found. Jun 17 08:52:57.714242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:57.714242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:57.714242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:57.714242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:57.714242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:57.714242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:57.714242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:52:57.714242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:52:57.714242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:52:57.715553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:52:57.715553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 17 08:52:57.715553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 08:52:57.715553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 17 08:52:57.715553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 08:52:57.715553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 17 08:52:57.715553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 17 08:52:57.715553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:52:57.715553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:52:57.715553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de could not be found. Jun 17 08:52:57.715553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:57.715553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:57.715553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:57.715553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:57.715553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:57.715553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:57.715553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:52:57.715553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:52:57.715553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de could not be found. Jun 17 08:52:57.715553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:57.721792 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-66149e78-542b-4ec2-9969-972983e572d0 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Returning 404 to user: Instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:52:57.721792 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-66149e78-542b-4ec2-9969-972983e572d0 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042624 Jun 17 08:52:57.721792 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 72/152] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 08:52:57 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:52:58.647865 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-f49f78a5-8635-4cc3-afb2-75d4be618c49 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-967809202", "imageRef": "978084c7-ed2c-4e42-ac8b-f5d19c4001fe", "flavorRef": "452", "networks": [{"uuid": "ba4c2740-eda9-41f4-b954-e1d4f9107a41"}]}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:52:58.716415 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.network.neutron [None req-f49f78a5-8635-4cc3-afb2-75d4be618c49 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] validate_networks() for [('ba4c2740-eda9-41f4-b954-e1d4f9107a41', None, None, None, None, None)] {{(pid=129876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:52:59.150828 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-f49f78a5-8635-4cc3-afb2-75d4be618c49 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Flavor limits 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:52:59.151263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-f49f78a5-8635-4cc3-afb2-75d4be618c49 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Image limits 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:52:59.151966 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-f49f78a5-8635-4cc3-afb2-75d4be618c49 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Flavor pref 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:52:59.152591 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-f49f78a5-8635-4cc3-afb2-75d4be618c49 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Image pref 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:52:59.153082 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-f49f78a5-8635-4cc3-afb2-75d4be618c49 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:52:59.163314 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f49f78a5-8635-4cc3-afb2-75d4be618c49 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:59.163805 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f49f78a5-8635-4cc3-afb2-75d4be618c49 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:59.164611 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f49f78a5-8635-4cc3-afb2-75d4be618c49 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:59.165055 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f49f78a5-8635-4cc3-afb2-75d4be618c49 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:59.179706 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-03f1d72b-fee2-40fd-9966-d7f1b1ee402e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:59.186569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-03f1d72b-fee2-40fd-9966-d7f1b1ee402e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:59.187667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-03f1d72b-fee2-40fd-9966-d7f1b1ee402e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:59.188122 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-03f1d72b-fee2-40fd-9966-d7f1b1ee402e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:59.189091 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-03f1d72b-fee2-40fd-9966-d7f1b1ee402e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:59.189689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-03f1d72b-fee2-40fd-9966-d7f1b1ee402e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:59.192816 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-f49f78a5-8635-4cc3-afb2-75d4be618c49 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Getting quotas for project 25f8de28a0664821af43d9cdccab292d. Resources: {'ram', 'cores', 'instances'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:52:59.197878 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-f49f78a5-8635-4cc3-afb2-75d4be618c49 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Getting quotas for user f571731515754890874b862a1407ebc0 and project 25f8de28a0664821af43d9cdccab292d. Resources: {'ram', 'cores', 'instances'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:52:59.205146 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-03f1d72b-fee2-40fd-9966-d7f1b1ee402e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] HTTP exception thrown: Instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de could not be found. Jun 17 08:52:59.207304 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-03f1d72b-fee2-40fd-9966-d7f1b1ee402e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Request method failure captured: Jun 17 08:52:59.207304 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: DELETE /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de HTTP/1.1 Jun 17 08:52:59.207304 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 08:52:59.207304 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 08:52:59.207304 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 08:52:59.207304 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 08:52:59.207304 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 08:52:59.207304 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 08:52:59.207304 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 08:52:59.207304 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 08:52:59.207304 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirECrIRWepm9QwywmPxl6a8Cd6CUxvQsmznyE4pMpx3CmIzJC67VNTkSiUiLu59ASxWrI-8qd6zMQC3vL8093TXtLVs62Cy6JfchmmEjVwXABYkg6B9gAChlahGkmYkBfXhohrgXEJFoTtmsW7FMPeNUkDhi9a2eP7rH8LjdRc4w5-50 Jun 17 08:52:59.207304 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 08:52:59.207304 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 08:52:59.207304 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 08:52:59.207304 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 08:52:59.207304 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 08:52:59.207304 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 08:52:59.207304 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: 63675a395d824db687bca143dc25c3b2 Jun 17 08:52:59.207304 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-DeleteServersTestJSON-603884224 Jun 17 08:52:59.207304 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 08:52:59.207304 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 08:52:59.214457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/63675a395d824db687bca143dc25c3b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/63675a395d824db687bca143dc25c3b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_63675a395d824db687bca143dc25c3b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/63675a395d824db687bca143dc25c3b2"}]}] Jun 17 08:52:59.214457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-DeleteServersTestJSON-603884224 Jun 17 08:52:59.214457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: 63675a395d824db687bca143dc25c3b2 Jun 17 08:52:59.214457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-DeleteServersTestJSON-603884224 Jun 17 08:52:59.214457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-DeleteServersTestJSON-603884224-project Jun 17 08:52:59.214457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 08:52:59.214457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 08:52:59.214457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: 72e4c92b149c4dffbdeba414d8803bf8 Jun 17 08:52:59.214457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-DeleteServersTestJSON-603884224-project Jun 17 08:52:59.214457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: > Jun 17 08:52:59.214457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de could not be found. Jun 17 08:52:59.214457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'id': '6a2cc759-7f2e-4308-aaf4-8ac7befa64de'} Jun 17 08:52:59.215817 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:52:59.215817 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:59.215817 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:52:59.215817 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:52:59.215817 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:52:59.215817 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:52:59.215817 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:52:59.215817 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:52:59.215817 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:52:59.215817 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:52:59.215817 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de could not be found. Jun 17 08:52:59.215817 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:59.215817 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:59.215817 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:59.215817 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:59.215817 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:59.215817 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:59.215817 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:52:59.215817 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:52:59.215817 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:52:59.216885 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:52:59.216885 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 08:52:59.216885 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 08:52:59.216885 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 08:52:59.216885 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 08:52:59.216885 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:52:59.216885 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:52:59.216885 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:52:59.216885 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:52:59.216885 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de could not be found. Jun 17 08:52:59.216885 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:59.216885 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:59.216885 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:59.216885 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:59.216885 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:59.216885 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:59.216885 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:52:59.216885 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:52:59.216885 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de could not be found. Jun 17 08:52:59.216885 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:59.218120 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-03f1d72b-fee2-40fd-9966-d7f1b1ee402e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Returning 404 to user: Instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:52:59.218120 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-03f1d72b-fee2-40fd-9966-d7f1b1ee402e tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 404 len: 111 microversion: 2.1 time: 0.032968 Jun 17 08:52:59.218120 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 73/153] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 08:52:59 2022] DELETE /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 08:52:59.219722 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-f49f78a5-8635-4cc3-afb2-75d4be618c49 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Going to run 1 instances... {{(pid=129876) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:52:59.220636 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-c5bc2328-fb14-42df-b5b0-1e4fbd69f270 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:59.221267 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-c5bc2328-fb14-42df-b5b0-1e4fbd69f270 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] [instance: 6a2cc759-7f2e-4308-aaf4-8ac7befa64de] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:59.222906 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-f49f78a5-8635-4cc3-afb2-75d4be618c49 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='978084c7-ed2c-4e42-ac8b-f5d19c4001fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:52:59.228028 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c5bc2328-fb14-42df-b5b0-1e4fbd69f270 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:59.228488 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c5bc2328-fb14-42df-b5b0-1e4fbd69f270 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:59.229582 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c5bc2328-fb14-42df-b5b0-1e4fbd69f270 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:59.230093 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c5bc2328-fb14-42df-b5b0-1e4fbd69f270 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:59.248580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-c5bc2328-fb14-42df-b5b0-1e4fbd69f270 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] HTTP exception thrown: Instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de could not be found. Jun 17 08:52:59.250489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-c5bc2328-fb14-42df-b5b0-1e4fbd69f270 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Request method failure captured: Jun 17 08:52:59.250489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de HTTP/1.1 Jun 17 08:52:59.250489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 08:52:59.250489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 08:52:59.250489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 08:52:59.250489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 08:52:59.250489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 08:52:59.250489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 08:52:59.250489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 08:52:59.250489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 08:52:59.250489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirECrIRWepm9QwywmPxl6a8Cd6CUxvQsmznyE4pMpx3CmIzJC67VNTkSiUiLu59ASxWrI-8qd6zMQC3vL8093TXtLVs62Cy6JfchmmEjVwXABYkg6B9gAChlahGkmYkBfXhohrgXEJFoTtmsW7FMPeNUkDhi9a2eP7rH8LjdRc4w5-50 Jun 17 08:52:59.250489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 08:52:59.250489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 08:52:59.250489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 08:52:59.250489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 08:52:59.250489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 08:52:59.250489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 08:52:59.250489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: 63675a395d824db687bca143dc25c3b2 Jun 17 08:52:59.250489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-DeleteServersTestJSON-603884224 Jun 17 08:52:59.250489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 08:52:59.250489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 08:52:59.251857 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/63675a395d824db687bca143dc25c3b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/63675a395d824db687bca143dc25c3b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_63675a395d824db687bca143dc25c3b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/63675a395d824db687bca143dc25c3b2"}]}] Jun 17 08:52:59.251857 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-DeleteServersTestJSON-603884224 Jun 17 08:52:59.251857 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: 63675a395d824db687bca143dc25c3b2 Jun 17 08:52:59.251857 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-DeleteServersTestJSON-603884224 Jun 17 08:52:59.251857 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-DeleteServersTestJSON-603884224-project Jun 17 08:52:59.251857 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 08:52:59.251857 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 08:52:59.251857 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: 72e4c92b149c4dffbdeba414d8803bf8 Jun 17 08:52:59.251857 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-DeleteServersTestJSON-603884224-project Jun 17 08:52:59.251857 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: > Jun 17 08:52:59.251857 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de could not be found. Jun 17 08:52:59.251857 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'id': '6a2cc759-7f2e-4308-aaf4-8ac7befa64de'} Jun 17 08:52:59.252634 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:52:59.252634 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:59.252634 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:52:59.252634 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:52:59.252634 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:52:59.252634 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:52:59.252634 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:52:59.252634 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:52:59.252634 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:52:59.252634 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:52:59.252634 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de could not be found. Jun 17 08:52:59.252634 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:59.252634 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:59.252634 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:59.252634 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:59.252634 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:59.252634 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:59.252634 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:52:59.252634 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:52:59.252634 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:52:59.254048 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:52:59.254048 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:52:59.254048 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:52:59.254048 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:52:59.254048 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:52:59.254048 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:52:59.254048 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:52:59.254048 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de could not be found. Jun 17 08:52:59.254048 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:59.254048 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:59.254048 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:59.254048 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:59.254048 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:59.254048 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:59.254048 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:52:59.254048 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:52:59.254048 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de could not be found. Jun 17 08:52:59.254048 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:52:59.255217 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-c5bc2328-fb14-42df-b5b0-1e4fbd69f270 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] Returning 404 to user: Instance 6a2cc759-7f2e-4308-aaf4-8ac7befa64de could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:52:59.255217 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-c5bc2328-fb14-42df-b5b0-1e4fbd69f270 tempest-DeleteServersTestJSON-603884224 tempest-DeleteServersTestJSON-603884224-project] 10.222.0.78 "GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de" status: 404 len: 111 microversion: 2.1 time: 0.037554 Jun 17 08:52:59.255217 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 74/154] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:59 2022] GET /compute/v2.1/servers/6a2cc759-7f2e-4308-aaf4-8ac7befa64de => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:52:59.345526 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-f49f78a5-8635-4cc3-afb2-75d4be618c49 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.702541 Jun 17 08:52:59.346345 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 81/155] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jun 17 08:52:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:52:59.356430 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3a095f0a-f595-4142-9c88-2f3b81e0bfe2 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:59.357190 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-3a095f0a-f595-4142-9c88-2f3b81e0bfe2 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:59.424977 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3a095f0a-f595-4142-9c88-2f3b81e0bfe2 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:59.433083 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-3a095f0a-f595-4142-9c88-2f3b81e0bfe2 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1218 microversion: 2.1 time: 0.080484 Jun 17 08:52:59.433895 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 75/156] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:59 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:00.451733 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-615a6cce-831f-4ee1-a729-561ae83fff6d tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:00.452365 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-615a6cce-831f-4ee1-a729-561ae83fff6d tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:00.508897 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-615a6cce-831f-4ee1-a729-561ae83fff6d tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:00.517342 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-615a6cce-831f-4ee1-a729-561ae83fff6d tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1218 microversion: 2.1 time: 0.069931 Jun 17 08:53:00.518783 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 82/157] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:00 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:01.536285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-fa1b2ddf-98f8-49c3-918c-04b290525ca3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:01.536925 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-fa1b2ddf-98f8-49c3-918c-04b290525ca3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:01.545497 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fa1b2ddf-98f8-49c3-918c-04b290525ca3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:01.545949 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fa1b2ddf-98f8-49c3-918c-04b290525ca3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:01.546732 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fa1b2ddf-98f8-49c3-918c-04b290525ca3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:01.547169 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fa1b2ddf-98f8-49c3-918c-04b290525ca3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:01.652206 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-fa1b2ddf-98f8-49c3-918c-04b290525ca3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:01.667640 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-fa1b2ddf-98f8-49c3-918c-04b290525ca3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1214 microversion: 2.1 time: 0.135960 Jun 17 08:53:01.668480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 76/158] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:01 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1214 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:02.700427 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-3d0c568c-c0c2-4fda-ae9b-1d690580dd27 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:02.701114 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-3d0c568c-c0c2-4fda-ae9b-1d690580dd27 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:02.711026 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3d0c568c-c0c2-4fda-ae9b-1d690580dd27 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:02.711586 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3d0c568c-c0c2-4fda-ae9b-1d690580dd27 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:02.718035 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3d0c568c-c0c2-4fda-ae9b-1d690580dd27 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:02.718035 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3d0c568c-c0c2-4fda-ae9b-1d690580dd27 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:02.896496 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-3d0c568c-c0c2-4fda-ae9b-1d690580dd27 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:02.918851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-3d0c568c-c0c2-4fda-ae9b-1d690580dd27 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1278 microversion: 2.1 time: 0.237096 Jun 17 08:53:02.921138 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 83/159] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:02 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1278 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:03.948337 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-7baefde1-2760-44f6-8b00-2dd938ea0613 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:03.950313 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-7baefde1-2760-44f6-8b00-2dd938ea0613 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:03.970921 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7baefde1-2760-44f6-8b00-2dd938ea0613 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:03.972308 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7baefde1-2760-44f6-8b00-2dd938ea0613 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:03.975932 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7baefde1-2760-44f6-8b00-2dd938ea0613 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:03.990070 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7baefde1-2760-44f6-8b00-2dd938ea0613 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:04.362133 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-7baefde1-2760-44f6-8b00-2dd938ea0613 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:04.370477 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-7baefde1-2760-44f6-8b00-2dd938ea0613 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1318 microversion: 2.1 time: 0.432745 Jun 17 08:53:04.371037 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 77/160] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:03 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:53:05.158184 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-57e44ffd-96e3-487d-bb18-78094872c192 req-f92af0a8-17c0-45be-8ec3-b8c0b96194f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edcd67d0-7a53-4e37-a947-a077ffd9bd71", "tag": "0089423c-f96d-4e7e-9d00-2111a2dc1752"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:53:05.158184 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-57e44ffd-96e3-487d-bb18-78094872c192 req-f92af0a8-17c0-45be-8ec3-b8c0b96194f4 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:05.158680 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-57e44ffd-96e3-487d-bb18-78094872c192 req-f92af0a8-17c0-45be-8ec3-b8c0b96194f4 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:05.171802 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-57e44ffd-96e3-487d-bb18-78094872c192 req-f92af0a8-17c0-45be-8ec3-b8c0b96194f4 service nova] Creating event network-changed:0089423c-f96d-4e7e-9d00-2111a2dc1752 for instance edcd67d0-7a53-4e37-a947-a077ffd9bd71 on hv-cinder-79760 Jun 17 08:53:05.177306 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-57e44ffd-96e3-487d-bb18-78094872c192 req-f92af0a8-17c0-45be-8ec3-b8c0b96194f4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031765 Jun 17 08:53:05.178090 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 84/161] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:53:05.395511 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-8d5b73d4-ccde-45c5-92be-bb24b73205cd tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:05.396845 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-8d5b73d4-ccde-45c5-92be-bb24b73205cd tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:05.404692 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8d5b73d4-ccde-45c5-92be-bb24b73205cd tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:05.405562 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8d5b73d4-ccde-45c5-92be-bb24b73205cd tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:05.406344 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8d5b73d4-ccde-45c5-92be-bb24b73205cd tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:05.407087 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8d5b73d4-ccde-45c5-92be-bb24b73205cd tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:05.711160 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-8d5b73d4-ccde-45c5-92be-bb24b73205cd tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:05.720203 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-8d5b73d4-ccde-45c5-92be-bb24b73205cd tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1318 microversion: 2.1 time: 0.330285 Jun 17 08:53:05.720778 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 78/162] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:05 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:06.738929 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-54d2b58b-1c46-4855-a5a3-bde838d1c2b2 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:06.740395 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-54d2b58b-1c46-4855-a5a3-bde838d1c2b2 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:06.747503 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-54d2b58b-1c46-4855-a5a3-bde838d1c2b2 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:06.747962 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-54d2b58b-1c46-4855-a5a3-bde838d1c2b2 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:06.748841 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-54d2b58b-1c46-4855-a5a3-bde838d1c2b2 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:06.749650 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-54d2b58b-1c46-4855-a5a3-bde838d1c2b2 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:06.941632 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-54d2b58b-1c46-4855-a5a3-bde838d1c2b2 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:06.949202 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-54d2b58b-1c46-4855-a5a3-bde838d1c2b2 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1318 microversion: 2.1 time: 0.214816 Jun 17 08:53:06.949950 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 85/163] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:06 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:07.966579 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-842afc34-1fdd-44d4-847a-f63b08b16e03 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:07.967232 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-842afc34-1fdd-44d4-847a-f63b08b16e03 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:07.974093 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-842afc34-1fdd-44d4-847a-f63b08b16e03 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:07.974749 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-842afc34-1fdd-44d4-847a-f63b08b16e03 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:07.975692 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-842afc34-1fdd-44d4-847a-f63b08b16e03 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:07.986688 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-842afc34-1fdd-44d4-847a-f63b08b16e03 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:08.199545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-842afc34-1fdd-44d4-847a-f63b08b16e03 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:08.228742 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-842afc34-1fdd-44d4-847a-f63b08b16e03 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1318 microversion: 2.1 time: 0.261901 Jun 17 08:53:08.235398 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 79/164] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:07 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:09.249767 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a6f5dc48-673d-48f8-aede-49ad6018e35e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:09.251334 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a6f5dc48-673d-48f8-aede-49ad6018e35e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:09.258953 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=2 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:09.261625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a6f5dc48-673d-48f8-aede-49ad6018e35e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:09.262619 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a6f5dc48-673d-48f8-aede-49ad6018e35e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:09.263948 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a6f5dc48-673d-48f8-aede-49ad6018e35e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:09.264804 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a6f5dc48-673d-48f8-aede-49ad6018e35e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:09.592831 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a6f5dc48-673d-48f8-aede-49ad6018e35e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:09.604057 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a6f5dc48-673d-48f8-aede-49ad6018e35e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1318 microversion: 2.1 time: 0.361473 Jun 17 08:53:09.604724 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 86/165] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:09 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:10.621550 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1892cf6a-04ce-4dd4-af7b-3eea7de46ad9 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:10.622783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-1892cf6a-04ce-4dd4-af7b-3eea7de46ad9 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:10.629439 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=2 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:10.631803 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1892cf6a-04ce-4dd4-af7b-3eea7de46ad9 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:10.632096 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1892cf6a-04ce-4dd4-af7b-3eea7de46ad9 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:10.633125 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1892cf6a-04ce-4dd4-af7b-3eea7de46ad9 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:10.633596 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1892cf6a-04ce-4dd4-af7b-3eea7de46ad9 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:10.902898 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-1892cf6a-04ce-4dd4-af7b-3eea7de46ad9 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:10.910814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-1892cf6a-04ce-4dd4-af7b-3eea7de46ad9 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1318 microversion: 2.1 time: 0.293685 Jun 17 08:53:10.911332 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 80/166] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:10 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:11.928670 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-45f50d80-e92b-409b-8ca6-203067e7ecee tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:11.929880 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-45f50d80-e92b-409b-8ca6-203067e7ecee tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:11.933265 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=8 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:11.937954 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-45f50d80-e92b-409b-8ca6-203067e7ecee tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:11.938388 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-45f50d80-e92b-409b-8ca6-203067e7ecee tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:11.939338 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-45f50d80-e92b-409b-8ca6-203067e7ecee tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:11.939962 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-45f50d80-e92b-409b-8ca6-203067e7ecee tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:12.247241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-45f50d80-e92b-409b-8ca6-203067e7ecee tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:12.264917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-45f50d80-e92b-409b-8ca6-203067e7ecee tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1318 microversion: 2.1 time: 0.340442 Jun 17 08:53:12.265721 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 87/167] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:11 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:53:13.283031 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-eae6a02c-42ae-4566-b05b-f044d6052ae4 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:13.283779 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-eae6a02c-42ae-4566-b05b-f044d6052ae4 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:13.293312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eae6a02c-42ae-4566-b05b-f044d6052ae4 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:13.293762 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eae6a02c-42ae-4566-b05b-f044d6052ae4 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:13.294713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eae6a02c-42ae-4566-b05b-f044d6052ae4 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:13.295168 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eae6a02c-42ae-4566-b05b-f044d6052ae4 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:13.560092 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-eae6a02c-42ae-4566-b05b-f044d6052ae4 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:13.576074 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-eae6a02c-42ae-4566-b05b-f044d6052ae4 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1318 microversion: 2.1 time: 0.297681 Jun 17 08:53:13.587260 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 81/168] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:13 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:14.168211 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-eabafe08-9896-4c91-a958-df69c22199dd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1438785544", "imageRef": "978084c7-ed2c-4e42-ac8b-f5d19c4001fe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:53:14.225382 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.network.neutron [None req-eabafe08-9896-4c91-a958-df69c22199dd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] validate_networks() for [('8fa13e99-aed9-4194-a577-7ffc636408e6', None, None, None, None, None)] {{(pid=129876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:53:14.594553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-feee54b2-1a3e-4147-8c4c-e6574497271f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:14.596185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-feee54b2-1a3e-4147-8c4c-e6574497271f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:14.604354 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-feee54b2-1a3e-4147-8c4c-e6574497271f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:14.607309 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-feee54b2-1a3e-4147-8c4c-e6574497271f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:14.607309 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-feee54b2-1a3e-4147-8c4c-e6574497271f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:14.607309 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-feee54b2-1a3e-4147-8c4c-e6574497271f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:14.816050 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-eabafe08-9896-4c91-a958-df69c22199dd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Flavor limits 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:53:14.816657 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-eabafe08-9896-4c91-a958-df69c22199dd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Image limits 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:53:14.817928 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-eabafe08-9896-4c91-a958-df69c22199dd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Flavor pref 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:53:14.818509 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-eabafe08-9896-4c91-a958-df69c22199dd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Image pref 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:53:14.819144 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-eabafe08-9896-4c91-a958-df69c22199dd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:53:14.829642 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-eabafe08-9896-4c91-a958-df69c22199dd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:14.830419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-eabafe08-9896-4c91-a958-df69c22199dd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:14.831458 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-eabafe08-9896-4c91-a958-df69c22199dd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:14.832045 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-eabafe08-9896-4c91-a958-df69c22199dd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:14.851901 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-eabafe08-9896-4c91-a958-df69c22199dd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Getting quotas for project 6cd5b6aa6edd4bafa8aec3e9d28ae980. Resources: {'ram', 'cores', 'instances'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:53:14.857066 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-eabafe08-9896-4c91-a958-df69c22199dd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Getting quotas for user 5e4214dbd10d491eb6afa50321edca88 and project 6cd5b6aa6edd4bafa8aec3e9d28ae980. Resources: {'ram', 'cores', 'instances'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:53:14.871075 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-eabafe08-9896-4c91-a958-df69c22199dd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Going to run 1 instances... {{(pid=129876) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:53:14.873761 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-eabafe08-9896-4c91-a958-df69c22199dd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='978084c7-ed2c-4e42-ac8b-f5d19c4001fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:53:14.897784 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-feee54b2-1a3e-4147-8c4c-e6574497271f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:14.906545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-feee54b2-1a3e-4147-8c4c-e6574497271f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1318 microversion: 2.1 time: 0.316089 Jun 17 08:53:14.907397 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 82/169] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:14 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:53:15.012923 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-eabafe08-9896-4c91-a958-df69c22199dd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.986111 Jun 17 08:53:15.013795 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 88/170] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jun 17 08:53:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:53:15.028871 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-b6b42771-ee25-4270-a186-d2bd41389aab tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:15.030805 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-b6b42771-ee25-4270-a186-d2bd41389aab tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:15.114404 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b6b42771-ee25-4270-a186-d2bd41389aab tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:15.126182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-b6b42771-ee25-4270-a186-d2bd41389aab tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1222 microversion: 2.1 time: 0.105040 Jun 17 08:53:15.127687 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 83/171] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:15 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:15.193050 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-301a09ef-2ff4-485b-9af7-2c4de046a316 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1255606941", "imageRef": "978084c7-ed2c-4e42-ac8b-f5d19c4001fe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:53:15.200367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-0532cd5f-d872-41ff-9773-0f0ba7bb42b7 req-6f8423fa-8a6c-44d3-96a5-1ce4979bab4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edcd67d0-7a53-4e37-a947-a077ffd9bd71", "name": "network-vif-plugged", "status": "completed", "tag": "0089423c-f96d-4e7e-9d00-2111a2dc1752"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:53:15.209617 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-0532cd5f-d872-41ff-9773-0f0ba7bb42b7 req-6f8423fa-8a6c-44d3-96a5-1ce4979bab4f service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:15.210197 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-0532cd5f-d872-41ff-9773-0f0ba7bb42b7 req-6f8423fa-8a6c-44d3-96a5-1ce4979bab4f service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:15.223148 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-0532cd5f-d872-41ff-9773-0f0ba7bb42b7 req-6f8423fa-8a6c-44d3-96a5-1ce4979bab4f service nova] Creating event network-vif-plugged:0089423c-f96d-4e7e-9d00-2111a2dc1752 for instance edcd67d0-7a53-4e37-a947-a077ffd9bd71 on hv-cinder-79760 Jun 17 08:53:15.238518 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-0532cd5f-d872-41ff-9773-0f0ba7bb42b7 req-6f8423fa-8a6c-44d3-96a5-1ce4979bab4f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032784 Jun 17 08:53:15.244186 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 84/172] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:53:15.300714 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.network.neutron [None req-301a09ef-2ff4-485b-9af7-2c4de046a316 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] validate_networks() for [('8fa13e99-aed9-4194-a577-7ffc636408e6', None, None, None, None, None)] {{(pid=129876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:53:15.808974 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-301a09ef-2ff4-485b-9af7-2c4de046a316 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Flavor limits 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:53:15.809922 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-301a09ef-2ff4-485b-9af7-2c4de046a316 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Image limits 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:53:15.810664 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-301a09ef-2ff4-485b-9af7-2c4de046a316 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Flavor pref 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:53:15.811665 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-301a09ef-2ff4-485b-9af7-2c4de046a316 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Image pref 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:53:15.812102 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-301a09ef-2ff4-485b-9af7-2c4de046a316 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:53:15.827210 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-301a09ef-2ff4-485b-9af7-2c4de046a316 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:15.827920 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-301a09ef-2ff4-485b-9af7-2c4de046a316 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:15.828936 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-301a09ef-2ff4-485b-9af7-2c4de046a316 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:15.829578 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-301a09ef-2ff4-485b-9af7-2c4de046a316 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:15.872274 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-301a09ef-2ff4-485b-9af7-2c4de046a316 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Getting quotas for project 6cd5b6aa6edd4bafa8aec3e9d28ae980. Resources: {'ram', 'cores', 'instances'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:53:15.882579 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-301a09ef-2ff4-485b-9af7-2c4de046a316 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Getting quotas for user 5e4214dbd10d491eb6afa50321edca88 and project 6cd5b6aa6edd4bafa8aec3e9d28ae980. Resources: {'ram', 'cores', 'instances'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:53:15.906557 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-301a09ef-2ff4-485b-9af7-2c4de046a316 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Going to run 1 instances... {{(pid=129876) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:53:15.908869 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-301a09ef-2ff4-485b-9af7-2c4de046a316 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='978084c7-ed2c-4e42-ac8b-f5d19c4001fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:53:15.926061 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-e416df46-4f5a-4866-b3b7-cba2927f9c64 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:15.926771 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-e416df46-4f5a-4866-b3b7-cba2927f9c64 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:15.934072 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e416df46-4f5a-4866-b3b7-cba2927f9c64 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:15.935070 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e416df46-4f5a-4866-b3b7-cba2927f9c64 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:15.936090 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e416df46-4f5a-4866-b3b7-cba2927f9c64 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:15.936789 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e416df46-4f5a-4866-b3b7-cba2927f9c64 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:16.124175 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-301a09ef-2ff4-485b-9af7-2c4de046a316 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.936316 Jun 17 08:53:16.131886 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 89/173] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jun 17 08:53:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:53:16.152726 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-3e4afd69-5565-4df5-8d1b-39da9e749463 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:16.154951 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-3e4afd69-5565-4df5-8d1b-39da9e749463 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:16.170912 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-e416df46-4f5a-4866-b3b7-cba2927f9c64 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:16.182891 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-e416df46-4f5a-4866-b3b7-cba2927f9c64 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1318 microversion: 2.1 time: 0.259249 Jun 17 08:53:16.192448 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 85/174] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:15 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:53:16.255612 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-3e4afd69-5565-4df5-8d1b-39da9e749463 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:16.269477 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-3e4afd69-5565-4df5-8d1b-39da9e749463 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1222 microversion: 2.1 time: 0.134103 Jun 17 08:53:16.270991 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 90/175] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:16 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1222 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:17.203270 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-59eb6ffe-fb26-493a-9a13-59efaef3c063 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:17.204799 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-59eb6ffe-fb26-493a-9a13-59efaef3c063 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:17.213052 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-59eb6ffe-fb26-493a-9a13-59efaef3c063 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:17.213773 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-59eb6ffe-fb26-493a-9a13-59efaef3c063 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:17.215161 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-59eb6ffe-fb26-493a-9a13-59efaef3c063 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:17.215888 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-59eb6ffe-fb26-493a-9a13-59efaef3c063 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:17.308211 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-bf90f699-3b1e-4842-9ba8-e70e263bdce6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:17.309117 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-bf90f699-3b1e-4842-9ba8-e70e263bdce6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:17.413876 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-bf90f699-3b1e-4842-9ba8-e70e263bdce6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:17.423918 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-bf90f699-3b1e-4842-9ba8-e70e263bdce6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1222 microversion: 2.1 time: 0.135542 Jun 17 08:53:17.424528 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 91/176] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:17 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1222 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:17.432772 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-59eb6ffe-fb26-493a-9a13-59efaef3c063 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:17.441892 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-59eb6ffe-fb26-493a-9a13-59efaef3c063 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1318 microversion: 2.1 time: 0.243551 Jun 17 08:53:17.443108 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 86/177] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:17 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:18.441774 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-8302e424-bfb5-4018-b123-75f5bfdad979 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:18.443513 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-8302e424-bfb5-4018-b123-75f5bfdad979 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:18.459334 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-624d3f54-c83a-45ad-89e2-a6ae4b68d882 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:18.460535 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-624d3f54-c83a-45ad-89e2-a6ae4b68d882 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:18.465981 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8302e424-bfb5-4018-b123-75f5bfdad979 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:18.467260 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8302e424-bfb5-4018-b123-75f5bfdad979 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:18.470444 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8302e424-bfb5-4018-b123-75f5bfdad979 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:18.471230 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8302e424-bfb5-4018-b123-75f5bfdad979 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:18.477232 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-624d3f54-c83a-45ad-89e2-a6ae4b68d882 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:18.478504 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-624d3f54-c83a-45ad-89e2-a6ae4b68d882 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:18.487907 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-624d3f54-c83a-45ad-89e2-a6ae4b68d882 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:18.490683 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-624d3f54-c83a-45ad-89e2-a6ae4b68d882 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:18.613118 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-8302e424-bfb5-4018-b123-75f5bfdad979 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:18.623246 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-8302e424-bfb5-4018-b123-75f5bfdad979 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1218 microversion: 2.1 time: 0.185305 Jun 17 08:53:18.624433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 92/178] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:18 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1218 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:18.718428 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-624d3f54-c83a-45ad-89e2-a6ae4b68d882 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:18.728291 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-624d3f54-c83a-45ad-89e2-a6ae4b68d882 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1318 microversion: 2.1 time: 0.272447 Jun 17 08:53:18.729031 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 87/179] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:18 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:19.640720 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-28042a18-3f05-4da4-a11a-9f63cc26d768 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:19.641327 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-28042a18-3f05-4da4-a11a-9f63cc26d768 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:19.647861 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-28042a18-3f05-4da4-a11a-9f63cc26d768 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:19.648539 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-28042a18-3f05-4da4-a11a-9f63cc26d768 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:19.649343 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-28042a18-3f05-4da4-a11a-9f63cc26d768 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:19.649772 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-28042a18-3f05-4da4-a11a-9f63cc26d768 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:19.723849 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-28042a18-3f05-4da4-a11a-9f63cc26d768 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:19.734430 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-28042a18-3f05-4da4-a11a-9f63cc26d768 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1274 microversion: 2.1 time: 0.097461 Jun 17 08:53:19.735484 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 93/180] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:19 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1274 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:19.746014 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-2680628c-79df-4454-b14f-466dbf760308 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:19.746627 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-2680628c-79df-4454-b14f-466dbf760308 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:19.754082 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2680628c-79df-4454-b14f-466dbf760308 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:19.754848 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2680628c-79df-4454-b14f-466dbf760308 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:19.756393 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2680628c-79df-4454-b14f-466dbf760308 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:19.757067 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2680628c-79df-4454-b14f-466dbf760308 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:20.082151 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2680628c-79df-4454-b14f-466dbf760308 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:20.097709 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-2680628c-79df-4454-b14f-466dbf760308 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1318 microversion: 2.1 time: 0.356097 Jun 17 08:53:20.107850 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 88/181] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:19 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:20.753291 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-48de3b15-7ec5-4f29-bd17-d9386b645b22 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:20.754634 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-48de3b15-7ec5-4f29-bd17-d9386b645b22 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:20.761284 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:20.764097 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-48de3b15-7ec5-4f29-bd17-d9386b645b22 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:20.765094 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-48de3b15-7ec5-4f29-bd17-d9386b645b22 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:20.766083 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-48de3b15-7ec5-4f29-bd17-d9386b645b22 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:20.769437 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-48de3b15-7ec5-4f29-bd17-d9386b645b22 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:21.034967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-48de3b15-7ec5-4f29-bd17-d9386b645b22 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:21.046090 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-48de3b15-7ec5-4f29-bd17-d9386b645b22 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1282 microversion: 2.1 time: 0.296842 Jun 17 08:53:21.056147 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 94/182] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:20 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1282 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:21.120373 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-bf22c2e9-26bb-4656-9cda-cd2a20aed337 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:21.120993 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-bf22c2e9-26bb-4656-9cda-cd2a20aed337 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:21.138527 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bf22c2e9-26bb-4656-9cda-cd2a20aed337 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:21.145289 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bf22c2e9-26bb-4656-9cda-cd2a20aed337 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:21.164265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bf22c2e9-26bb-4656-9cda-cd2a20aed337 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:21.165248 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bf22c2e9-26bb-4656-9cda-cd2a20aed337 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:21.189153 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=100 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:21.496048 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-bf22c2e9-26bb-4656-9cda-cd2a20aed337 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:21.506594 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-bf22c2e9-26bb-4656-9cda-cd2a20aed337 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1506 microversion: 2.1 time: 0.395154 Jun 17 08:53:21.507936 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 89/183] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:21 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1506 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:22.068607 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-2939e7ad-a610-41d1-8007-108c0766fab8 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:22.070186 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-2939e7ad-a610-41d1-8007-108c0766fab8 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:22.110073 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2939e7ad-a610-41d1-8007-108c0766fab8 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:22.114835 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2939e7ad-a610-41d1-8007-108c0766fab8 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:22.115832 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2939e7ad-a610-41d1-8007-108c0766fab8 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:22.116298 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2939e7ad-a610-41d1-8007-108c0766fab8 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:22.130141 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:22.283032 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-2939e7ad-a610-41d1-8007-108c0766fab8 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:22.299097 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-2939e7ad-a610-41d1-8007-108c0766fab8 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1280 microversion: 2.1 time: 0.234764 Jun 17 08:53:22.299751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 95/184] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:22 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1280 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:23.317752 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-bd051566-3fb6-48ab-8424-9dc2e1d9a49a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:23.318961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-bd051566-3fb6-48ab-8424-9dc2e1d9a49a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:23.326289 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=49 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:23.328699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bd051566-3fb6-48ab-8424-9dc2e1d9a49a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:23.331615 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bd051566-3fb6-48ab-8424-9dc2e1d9a49a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:23.331615 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bd051566-3fb6-48ab-8424-9dc2e1d9a49a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:23.331615 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bd051566-3fb6-48ab-8424-9dc2e1d9a49a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:23.490753 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-6ded2db6-e55c-4265-81f5-5546d981be5a req-72f63a1f-20f2-4528-8d85-7c2b0ddfd548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "597a895e-45db-42bf-9c7f-40a13eedc48b", "tag": "bcdeb004-186e-437b-8253-335f017eebbd"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:53:23.548675 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-6ded2db6-e55c-4265-81f5-5546d981be5a req-72f63a1f-20f2-4528-8d85-7c2b0ddfd548 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:23.548675 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-6ded2db6-e55c-4265-81f5-5546d981be5a req-72f63a1f-20f2-4528-8d85-7c2b0ddfd548 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:23.555215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-bd051566-3fb6-48ab-8424-9dc2e1d9a49a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:23.591770 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-bd051566-3fb6-48ab-8424-9dc2e1d9a49a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1322 microversion: 2.1 time: 0.267703 Jun 17 08:53:23.591770 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 90/185] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:23 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:23.592239 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-6ded2db6-e55c-4265-81f5-5546d981be5a req-72f63a1f-20f2-4528-8d85-7c2b0ddfd548 service nova] Creating event network-changed:bcdeb004-186e-437b-8253-335f017eebbd for instance 597a895e-45db-42bf-9c7f-40a13eedc48b on hv-cinder-79760 Jun 17 08:53:23.597936 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-6ded2db6-e55c-4265-81f5-5546d981be5a req-72f63a1f-20f2-4528-8d85-7c2b0ddfd548 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116965 Jun 17 08:53:23.598659 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 96/186] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:53:24.386815 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-4f4fcb57-077b-44e3-aa60-28dd67e3ad75 req-aefcddba-b5ba-4506-b4f9-de2e59bfffb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32006679-bcd4-46b4-b3b6-b2e0cc46ffc7", "tag": "f04f9926-c78f-453a-92df-f4e826f339e0"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:53:24.409759 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-4f4fcb57-077b-44e3-aa60-28dd67e3ad75 req-aefcddba-b5ba-4506-b4f9-de2e59bfffb1 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:24.419854 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-4f4fcb57-077b-44e3-aa60-28dd67e3ad75 req-aefcddba-b5ba-4506-b4f9-de2e59bfffb1 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:24.466318 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-4f4fcb57-077b-44e3-aa60-28dd67e3ad75 req-aefcddba-b5ba-4506-b4f9-de2e59bfffb1 service nova] Creating event network-changed:f04f9926-c78f-453a-92df-f4e826f339e0 for instance 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 on hv-cinder-79760 Jun 17 08:53:24.481150 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-4f4fcb57-077b-44e3-aa60-28dd67e3ad75 req-aefcddba-b5ba-4506-b4f9-de2e59bfffb1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104824 Jun 17 08:53:24.483636 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 91/187] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:53:24.600583 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-4cd11c1a-72af-4a4b-9a9c-f2059128970f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:24.601303 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-4cd11c1a-72af-4a4b-9a9c-f2059128970f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:24.623322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4cd11c1a-72af-4a4b-9a9c-f2059128970f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:24.625093 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4cd11c1a-72af-4a4b-9a9c-f2059128970f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:24.625885 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4cd11c1a-72af-4a4b-9a9c-f2059128970f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:24.627978 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4cd11c1a-72af-4a4b-9a9c-f2059128970f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:25.148047 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-4cd11c1a-72af-4a4b-9a9c-f2059128970f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:25.169184 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-4cd11c1a-72af-4a4b-9a9c-f2059128970f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1322 microversion: 2.1 time: 0.573637 Jun 17 08:53:25.170619 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 97/188] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:24 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1322 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:26.187926 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-09093cbb-8fdc-41ca-8bf8-4b1cf00f6134 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:26.189349 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-09093cbb-8fdc-41ca-8bf8-4b1cf00f6134 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:26.195608 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=2 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:26.198825 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-09093cbb-8fdc-41ca-8bf8-4b1cf00f6134 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:26.199605 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-09093cbb-8fdc-41ca-8bf8-4b1cf00f6134 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:26.200822 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-09093cbb-8fdc-41ca-8bf8-4b1cf00f6134 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:26.201483 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-09093cbb-8fdc-41ca-8bf8-4b1cf00f6134 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:26.453873 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-09093cbb-8fdc-41ca-8bf8-4b1cf00f6134 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:26.466093 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-09093cbb-8fdc-41ca-8bf8-4b1cf00f6134 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1322 microversion: 2.1 time: 0.282627 Jun 17 08:53:26.477130 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 92/189] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:26 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:27.485509 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-ec56e298-abe1-4c94-bd3b-e093368f186d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:27.486212 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-ec56e298-abe1-4c94-bd3b-e093368f186d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:27.488450 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=4 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:27.489379 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=16 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:27.498615 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ec56e298-abe1-4c94-bd3b-e093368f186d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:27.499752 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ec56e298-abe1-4c94-bd3b-e093368f186d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:27.501440 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ec56e298-abe1-4c94-bd3b-e093368f186d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:27.511294 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ec56e298-abe1-4c94-bd3b-e093368f186d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:27.798040 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-ec56e298-abe1-4c94-bd3b-e093368f186d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:27.806709 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-ec56e298-abe1-4c94-bd3b-e093368f186d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1322 microversion: 2.1 time: 0.325395 Jun 17 08:53:27.822067 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 98/190] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:27 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1322 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:28.831289 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-f84735b2-8726-46d8-a364-87dd4855b104 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:28.831289 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-f84735b2-8726-46d8-a364-87dd4855b104 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:28.840098 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f84735b2-8726-46d8-a364-87dd4855b104 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:28.840792 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f84735b2-8726-46d8-a364-87dd4855b104 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:28.841647 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f84735b2-8726-46d8-a364-87dd4855b104 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:28.842185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f84735b2-8726-46d8-a364-87dd4855b104 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:29.090086 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f84735b2-8726-46d8-a364-87dd4855b104 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:29.099958 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-f84735b2-8726-46d8-a364-87dd4855b104 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1322 microversion: 2.1 time: 0.277262 Jun 17 08:53:29.103207 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 93/191] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:28 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:30.137986 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-cc7c66f1-ffff-41ba-8e1d-81135c4d141d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:30.137986 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-cc7c66f1-ffff-41ba-8e1d-81135c4d141d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:30.145350 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-cc7c66f1-ffff-41ba-8e1d-81135c4d141d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:30.146193 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-cc7c66f1-ffff-41ba-8e1d-81135c4d141d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:30.147158 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-cc7c66f1-ffff-41ba-8e1d-81135c4d141d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:30.147949 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-cc7c66f1-ffff-41ba-8e1d-81135c4d141d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:30.438343 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-cc7c66f1-ffff-41ba-8e1d-81135c4d141d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:30.459851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-cc7c66f1-ffff-41ba-8e1d-81135c4d141d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1322 microversion: 2.1 time: 0.332162 Jun 17 08:53:30.460742 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 99/192] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:30 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:31.481624 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0c0019d1-9790-4f36-a01f-424f4f69c89c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:31.483921 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0c0019d1-9790-4f36-a01f-424f4f69c89c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:31.504546 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-5f049d0a-236d-4b2d-b689-3d007e0e354f req-1b54b519-d2af-40ce-bbae-22785148ee44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "597a895e-45db-42bf-9c7f-40a13eedc48b", "name": "network-vif-plugged", "status": "completed", "tag": "bcdeb004-186e-437b-8253-335f017eebbd"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:53:31.505813 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0c0019d1-9790-4f36-a01f-424f4f69c89c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:31.506496 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0c0019d1-9790-4f36-a01f-424f4f69c89c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:31.507275 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0c0019d1-9790-4f36-a01f-424f4f69c89c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:31.507776 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0c0019d1-9790-4f36-a01f-424f4f69c89c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:31.514547 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-5f049d0a-236d-4b2d-b689-3d007e0e354f req-1b54b519-d2af-40ce-bbae-22785148ee44 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:31.515225 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-5f049d0a-236d-4b2d-b689-3d007e0e354f req-1b54b519-d2af-40ce-bbae-22785148ee44 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:31.532611 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-5f049d0a-236d-4b2d-b689-3d007e0e354f req-1b54b519-d2af-40ce-bbae-22785148ee44 service nova] Creating event network-vif-plugged:bcdeb004-186e-437b-8253-335f017eebbd for instance 597a895e-45db-42bf-9c7f-40a13eedc48b on hv-cinder-79760 Jun 17 08:53:31.543724 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-5f049d0a-236d-4b2d-b689-3d007e0e354f req-1b54b519-d2af-40ce-bbae-22785148ee44 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042035 Jun 17 08:53:31.545162 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 100/193] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:53:32.233478 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0c0019d1-9790-4f36-a01f-424f4f69c89c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:32.256449 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0c0019d1-9790-4f36-a01f-424f4f69c89c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1322 microversion: 2.1 time: 0.782114 Jun 17 08:53:32.257109 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 94/194] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:31 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1322 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:53:33.059125 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-5ecb7a5b-d108-41e7-90e2-48124c9bcd2b tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Action: 'create', calling method: .version_select at 0x7fbc33ea13a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1164176646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5yPzPRWbDQ+6oFEUBL9dDwJ9bnpC565cpu660bus/MoM3H1y8VsPTx8X/CY0qmL2sMM2hNsOWkMy8W/E74PJkHUYCXNjf8tmpMW0NAxi7YbpZqFXpQn7bcwryo9A3KFg=="}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:53:33.074581 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-5ecb7a5b-d108-41e7-90e2-48124c9bcd2b tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Getting quotas for project 7e69cf14c3c8482fbf95620efe1bee1d. Resources: {'key_pairs'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:53:33.078944 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-5ecb7a5b-d108-41e7-90e2-48124c9bcd2b tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Getting quotas for user fec25ac241c94d4dbebb361c55f10f75 and project 7e69cf14c3c8482fbf95620efe1bee1d. Resources: {'key_pairs'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:53:33.195603 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-8d813649-c519-4cf1-ba89-68ecf8684840 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:33.195603 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-8d813649-c519-4cf1-ba89-68ecf8684840 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:33.207971 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8d813649-c519-4cf1-ba89-68ecf8684840 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:33.209157 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8d813649-c519-4cf1-ba89-68ecf8684840 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:33.211411 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8d813649-c519-4cf1-ba89-68ecf8684840 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:33.212635 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8d813649-c519-4cf1-ba89-68ecf8684840 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:33.223634 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-5ecb7a5b-d108-41e7-90e2-48124c9bcd2b tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.435717 Jun 17 08:53:33.224709 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 101/195] 10.222.0.78 () {60 vars in 1158 bytes} [Fri Jun 17 08:53:32 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:53:33.275625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-eda3a3fb-c386-4b98-90f7-9b64f6fd46f7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:33.276727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-eda3a3fb-c386-4b98-90f7-9b64f6fd46f7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:33.290046 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-eda3a3fb-c386-4b98-90f7-9b64f6fd46f7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:33.293851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-eda3a3fb-c386-4b98-90f7-9b64f6fd46f7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:33.294790 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-eda3a3fb-c386-4b98-90f7-9b64f6fd46f7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:33.295963 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-8d813649-c519-4cf1-ba89-68ecf8684840 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc/ips" status: 200 len: 150 microversion: 2.1 time: 0.107455 Jun 17 08:53:33.296523 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-eda3a3fb-c386-4b98-90f7-9b64f6fd46f7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:33.299923 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 95/196] 10.222.0.78 () {58 vars in 1247 bytes} [Fri Jun 17 08:53:33 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc/ips => generated 150 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:53:33.519981 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-eda3a3fb-c386-4b98-90f7-9b64f6fd46f7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:33.531396 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-eda3a3fb-c386-4b98-90f7-9b64f6fd46f7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1322 microversion: 2.1 time: 0.261298 Jun 17 08:53:33.533391 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 102/197] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:33 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:53:33.723066 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1fda92df-f8c0-4eb0-8121-7f2cfeb10ca0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:33.723600 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-1fda92df-f8c0-4eb0-8121-7f2cfeb10ca0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:33.733229 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1fda92df-f8c0-4eb0-8121-7f2cfeb10ca0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:33.733692 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1fda92df-f8c0-4eb0-8121-7f2cfeb10ca0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:33.734814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1fda92df-f8c0-4eb0-8121-7f2cfeb10ca0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:33.735253 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1fda92df-f8c0-4eb0-8121-7f2cfeb10ca0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:33.775371 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-1fda92df-f8c0-4eb0-8121-7f2cfeb10ca0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976/ips" status: 200 len: 153 microversion: 2.20 time: 0.056516 Jun 17 08:53:33.777066 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 96/198] 10.222.0.78 () {60 vars in 1288 bytes} [Fri Jun 17 08:53:33 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976/ips => generated 153 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:53:34.552438 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-28428a56-8f71-4a62-8b2c-302bda0b0a3f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:34.553077 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-28428a56-8f71-4a62-8b2c-302bda0b0a3f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:34.562834 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-28428a56-8f71-4a62-8b2c-302bda0b0a3f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:34.569297 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-28428a56-8f71-4a62-8b2c-302bda0b0a3f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:34.570136 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-28428a56-8f71-4a62-8b2c-302bda0b0a3f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:34.570581 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-28428a56-8f71-4a62-8b2c-302bda0b0a3f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:34.855813 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-28428a56-8f71-4a62-8b2c-302bda0b0a3f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:34.877180 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-28428a56-8f71-4a62-8b2c-302bda0b0a3f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1322 microversion: 2.1 time: 0.328664 Jun 17 08:53:34.888577 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 103/199] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:34 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1322 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:35.897103 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a0f0cb4d-2a53-49b9-8f56-685dea77903b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:35.897802 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-a0f0cb4d-2a53-49b9-8f56-685dea77903b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:35.908315 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a0f0cb4d-2a53-49b9-8f56-685dea77903b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:35.908781 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a0f0cb4d-2a53-49b9-8f56-685dea77903b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:35.909559 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a0f0cb4d-2a53-49b9-8f56-685dea77903b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:35.912811 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a0f0cb4d-2a53-49b9-8f56-685dea77903b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:36.124683 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a0f0cb4d-2a53-49b9-8f56-685dea77903b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:36.133876 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-a0f0cb4d-2a53-49b9-8f56-685dea77903b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1322 microversion: 2.1 time: 0.241131 Jun 17 08:53:36.134828 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 97/200] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:35 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:36.207481 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-7953ccca-736f-42a2-95d4-4598c5817bf5 req-a47a8ab6-4ea7-48d5-9e64-292ff3fc14a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32006679-bcd4-46b4-b3b6-b2e0cc46ffc7", "name": "network-vif-plugged", "status": "completed", "tag": "f04f9926-c78f-453a-92df-f4e826f339e0"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:53:36.216917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-7953ccca-736f-42a2-95d4-4598c5817bf5 req-a47a8ab6-4ea7-48d5-9e64-292ff3fc14a2 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:36.217581 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-7953ccca-736f-42a2-95d4-4598c5817bf5 req-a47a8ab6-4ea7-48d5-9e64-292ff3fc14a2 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:36.239502 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-7953ccca-736f-42a2-95d4-4598c5817bf5 req-a47a8ab6-4ea7-48d5-9e64-292ff3fc14a2 service nova] Creating event network-vif-plugged:f04f9926-c78f-453a-92df-f4e826f339e0 for instance 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 on hv-cinder-79760 Jun 17 08:53:36.255388 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-7953ccca-736f-42a2-95d4-4598c5817bf5 req-a47a8ab6-4ea7-48d5-9e64-292ff3fc14a2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050264 Jun 17 08:53:36.257329 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 104/201] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:53:37.153809 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-f0c3dda7-0439-4a80-b1ad-ee7730cce008 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:37.154648 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-f0c3dda7-0439-4a80-b1ad-ee7730cce008 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:37.186186 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f0c3dda7-0439-4a80-b1ad-ee7730cce008 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:37.186186 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f0c3dda7-0439-4a80-b1ad-ee7730cce008 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:37.186905 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f0c3dda7-0439-4a80-b1ad-ee7730cce008 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:37.187374 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f0c3dda7-0439-4a80-b1ad-ee7730cce008 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:37.400607 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f0c3dda7-0439-4a80-b1ad-ee7730cce008 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:37.410600 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-f0c3dda7-0439-4a80-b1ad-ee7730cce008 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1322 microversion: 2.1 time: 0.261806 Jun 17 08:53:37.415737 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 98/202] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:37 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:37.981312 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-ffe73e52-02fa-479c-86f4-25e767fc4ce8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50996de5-7315-41a7-a05d-015e4d0c4ad1"}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:53:37.983538 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-ffe73e52-02fa-479c-86f4-25e767fc4ce8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:37.993021 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ffe73e52-02fa-479c-86f4-25e767fc4ce8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:37.993776 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ffe73e52-02fa-479c-86f4-25e767fc4ce8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:37.994893 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ffe73e52-02fa-479c-86f4-25e767fc4ce8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:37.995532 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ffe73e52-02fa-479c-86f4-25e767fc4ce8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:38.436421 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-b024bbc2-bd86-4aa0-a115-818510100603 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:38.437715 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-b024bbc2-bd86-4aa0-a115-818510100603 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:38.447525 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b024bbc2-bd86-4aa0-a115-818510100603 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:38.448376 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b024bbc2-bd86-4aa0-a115-818510100603 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:38.456627 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b024bbc2-bd86-4aa0-a115-818510100603 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:38.463469 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b024bbc2-bd86-4aa0-a115-818510100603 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:38.748240 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b024bbc2-bd86-4aa0-a115-818510100603 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:38.765242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-b024bbc2-bd86-4aa0-a115-818510100603 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1322 microversion: 2.1 time: 0.336072 Jun 17 08:53:38.766295 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 99/203] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:38 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:39.436396 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3d17f577-3efb-498c-9e87-fb3a16ac511b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:53:39.437075 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-3d17f577-3efb-498c-9e87-fb3a16ac511b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:39.448109 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3d17f577-3efb-498c-9e87-fb3a16ac511b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:39.448633 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3d17f577-3efb-498c-9e87-fb3a16ac511b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:39.449614 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3d17f577-3efb-498c-9e87-fb3a16ac511b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:39.450333 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3d17f577-3efb-498c-9e87-fb3a16ac511b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:39.491424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-3d17f577-3efb-498c-9e87-fb3a16ac511b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lazy-loading 'flavor' on Instance uuid 397d996b-b163-4a47-856e-f2aca2ae6976 {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:53:40.459695 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-3d17f577-3efb-498c-9e87-fb3a16ac511b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "POST /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976/action" status: 202 len: 0 microversion: 2.20 time: 1.035451 Jun 17 08:53:40.464093 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 100/204] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jun 17 08:53:39 2022] POST /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976/action => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:53:40.469609 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-325289ad-ad34-4fb3-923e-8a2e5a5d04a3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:40.473779 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-325289ad-ad34-4fb3-923e-8a2e5a5d04a3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:40.506051 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-325289ad-ad34-4fb3-923e-8a2e5a5d04a3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:40.506703 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-325289ad-ad34-4fb3-923e-8a2e5a5d04a3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:40.514539 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-325289ad-ad34-4fb3-923e-8a2e5a5d04a3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:40.515008 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-325289ad-ad34-4fb3-923e-8a2e5a5d04a3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:40.788311 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-325289ad-ad34-4fb3-923e-8a2e5a5d04a3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:40.797267 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-325289ad-ad34-4fb3-923e-8a2e5a5d04a3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1515 microversion: 2.1 time: 0.331868 Jun 17 08:53:40.798463 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 101/205] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:40 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1515 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:40.820742 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-2d59f7e3-604a-4f3a-8fcb-48134ec128be tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:40.822051 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-2d59f7e3-604a-4f3a-8fcb-48134ec128be tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:40.832540 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2d59f7e3-604a-4f3a-8fcb-48134ec128be tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:40.833379 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2d59f7e3-604a-4f3a-8fcb-48134ec128be tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:40.834361 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2d59f7e3-604a-4f3a-8fcb-48134ec128be tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:40.834956 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2d59f7e3-604a-4f3a-8fcb-48134ec128be tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:41.002958 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2d59f7e3-604a-4f3a-8fcb-48134ec128be tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:41.029154 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2d59f7e3-604a-4f3a-8fcb-48134ec128be tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:41.035482 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2d59f7e3-604a-4f3a-8fcb-48134ec128be tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:41.037766 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-2d59f7e3-604a-4f3a-8fcb-48134ec128be tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1724 microversion: 2.20 time: 0.237361 Jun 17 08:53:41.039236 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 102/206] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:53:40 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:53:41.046194 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-93dc8f7b-9c3f-4350-9226-a537684b2437 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:53:41.050699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-93dc8f7b-9c3f-4350-9226-a537684b2437 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:41.059834 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-93dc8f7b-9c3f-4350-9226-a537684b2437 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:41.060512 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-93dc8f7b-9c3f-4350-9226-a537684b2437 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:41.061117 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-93dc8f7b-9c3f-4350-9226-a537684b2437 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:41.061552 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-93dc8f7b-9c3f-4350-9226-a537684b2437 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:41.088521 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-93dc8f7b-9c3f-4350-9226-a537684b2437 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lazy-loading 'flavor' on Instance uuid 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:53:41.254692 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:41.458834 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-93dc8f7b-9c3f-4350-9226-a537684b2437 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "POST /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7/action" status: 200 len: 32 microversion: 2.1 time: 0.416466 Jun 17 08:53:41.460110 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 103/207] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jun 17 08:53:41 2022] POST /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7/action => generated 32 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 08:53:41.472891 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-f539d0c4-261a-475d-a963-fef61176d9d3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:41.473812 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-f539d0c4-261a-475d-a963-fef61176d9d3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:41.484878 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f539d0c4-261a-475d-a963-fef61176d9d3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:41.485572 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f539d0c4-261a-475d-a963-fef61176d9d3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:41.486564 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f539d0c4-261a-475d-a963-fef61176d9d3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:41.487063 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f539d0c4-261a-475d-a963-fef61176d9d3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:41.678333 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f539d0c4-261a-475d-a963-fef61176d9d3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:41.688604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-f539d0c4-261a-475d-a963-fef61176d9d3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.220232 Jun 17 08:53:41.689199 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 104/208] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:41 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:42.062688 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a79da6bd-f69b-454e-99eb-05d56ee8a038 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:42.063016 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-a79da6bd-f69b-454e-99eb-05d56ee8a038 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:42.069814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a79da6bd-f69b-454e-99eb-05d56ee8a038 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:42.071136 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a79da6bd-f69b-454e-99eb-05d56ee8a038 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:42.074014 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a79da6bd-f69b-454e-99eb-05d56ee8a038 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:42.074014 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a79da6bd-f69b-454e-99eb-05d56ee8a038 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:42.322861 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a79da6bd-f69b-454e-99eb-05d56ee8a038 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:42.330927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a79da6bd-f69b-454e-99eb-05d56ee8a038 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:42.332741 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a79da6bd-f69b-454e-99eb-05d56ee8a038 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:42.334612 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-a79da6bd-f69b-454e-99eb-05d56ee8a038 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1724 microversion: 2.20 time: 0.276213 Jun 17 08:53:42.335517 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 105/209] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:53:42 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:53:42.705852 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-12d7c40a-a7fe-4eb9-b4dd-26d66e92221a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:42.706509 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-12d7c40a-a7fe-4eb9-b4dd-26d66e92221a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:42.712931 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-12d7c40a-a7fe-4eb9-b4dd-26d66e92221a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:42.713379 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-12d7c40a-a7fe-4eb9-b4dd-26d66e92221a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:42.714144 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-12d7c40a-a7fe-4eb9-b4dd-26d66e92221a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:42.714579 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-12d7c40a-a7fe-4eb9-b4dd-26d66e92221a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:43.087551 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=4 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:43.244832 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-12d7c40a-a7fe-4eb9-b4dd-26d66e92221a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:43.264743 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-12d7c40a-a7fe-4eb9-b4dd-26d66e92221a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.554855 Jun 17 08:53:43.265421 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 106/210] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:42 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:53:43.363919 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-5facc0ec-4b3a-4377-9203-72388534357f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:43.364468 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-5facc0ec-4b3a-4377-9203-72388534357f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:43.374947 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5facc0ec-4b3a-4377-9203-72388534357f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:43.375693 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5facc0ec-4b3a-4377-9203-72388534357f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:43.376934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5facc0ec-4b3a-4377-9203-72388534357f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:43.377526 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5facc0ec-4b3a-4377-9203-72388534357f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:43.517264 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-ffe73e52-02fa-479c-86f4-25e767fc4ce8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "POST /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.543473 Jun 17 08:53:43.519631 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 105/211] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jun 17 08:53:37 2022] POST /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc/os-volume_attachments => generated 194 bytes in 5547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:53:43.718861 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-5facc0ec-4b3a-4377-9203-72388534357f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:43.730170 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-5facc0ec-4b3a-4377-9203-72388534357f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:43.731749 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-5facc0ec-4b3a-4377-9203-72388534357f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:43.733022 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-5facc0ec-4b3a-4377-9203-72388534357f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1724 microversion: 2.20 time: 0.374404 Jun 17 08:53:43.733596 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 107/212] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:53:43 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1724 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:53:44.284150 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-8085eb76-edd9-4b21-a928-24d44f4790a9 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:44.285089 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-8085eb76-edd9-4b21-a928-24d44f4790a9 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:44.293526 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8085eb76-edd9-4b21-a928-24d44f4790a9 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:44.294391 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8085eb76-edd9-4b21-a928-24d44f4790a9 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:44.295282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8085eb76-edd9-4b21-a928-24d44f4790a9 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:44.295854 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8085eb76-edd9-4b21-a928-24d44f4790a9 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:44.542244 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-8085eb76-edd9-4b21-a928-24d44f4790a9 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:44.567189 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-8085eb76-edd9-4b21-a928-24d44f4790a9 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.288096 Jun 17 08:53:44.576721 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 106/213] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:44 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:44.759267 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-23ba1aa2-aba4-445a-8de3-3fe8edcdb058 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:44.765354 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-23ba1aa2-aba4-445a-8de3-3fe8edcdb058 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:44.780084 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-23ba1aa2-aba4-445a-8de3-3fe8edcdb058 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:44.781370 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-23ba1aa2-aba4-445a-8de3-3fe8edcdb058 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:44.782213 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-23ba1aa2-aba4-445a-8de3-3fe8edcdb058 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:44.783016 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-23ba1aa2-aba4-445a-8de3-3fe8edcdb058 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:44.856095 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-041a0e8f-f06b-4d4c-b868-e3f9bfa4bba7 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9856711-49a8-4477-a524-a2f8e7f909df", "device": "/dev/sdb"}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:53:44.863082 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-041a0e8f-f06b-4d4c-b868-e3f9bfa4bba7 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:44.866654 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-041a0e8f-f06b-4d4c-b868-e3f9bfa4bba7 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:44.867903 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-041a0e8f-f06b-4d4c-b868-e3f9bfa4bba7 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:44.869138 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-041a0e8f-f06b-4d4c-b868-e3f9bfa4bba7 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:44.870233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-041a0e8f-f06b-4d4c-b868-e3f9bfa4bba7 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:45.092634 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-23ba1aa2-aba4-445a-8de3-3fe8edcdb058 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:45.101161 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-23ba1aa2-aba4-445a-8de3-3fe8edcdb058 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:45.104510 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-23ba1aa2-aba4-445a-8de3-3fe8edcdb058 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:45.110551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-23ba1aa2-aba4-445a-8de3-3fe8edcdb058 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1724 microversion: 2.20 time: 0.359523 Jun 17 08:53:45.120373 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 108/214] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:53:44 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1724 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:53:45.584478 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-8a09fdcb-977f-41f5-82ff-0db634502008 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:45.585394 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-8a09fdcb-977f-41f5-82ff-0db634502008 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:45.599183 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8a09fdcb-977f-41f5-82ff-0db634502008 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:45.600831 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8a09fdcb-977f-41f5-82ff-0db634502008 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:45.605101 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8a09fdcb-977f-41f5-82ff-0db634502008 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:45.605791 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8a09fdcb-977f-41f5-82ff-0db634502008 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:45.875768 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-041a0e8f-f06b-4d4c-b868-e3f9bfa4bba7 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "POST /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.024008 Jun 17 08:53:45.877867 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 107/215] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jun 17 08:53:44 2022] POST /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71/os-volume_attachments => generated 194 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:53:46.060121 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-8a09fdcb-977f-41f5-82ff-0db634502008 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:46.074493 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-8a09fdcb-977f-41f5-82ff-0db634502008 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.494737 Jun 17 08:53:46.087518 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 109/216] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:45 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:53:46.139987 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-4b47f4e7-26dd-4e94-9d48-306799e2b9e6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:46.140798 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-4b47f4e7-26dd-4e94-9d48-306799e2b9e6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:46.147467 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4b47f4e7-26dd-4e94-9d48-306799e2b9e6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:46.147917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4b47f4e7-26dd-4e94-9d48-306799e2b9e6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:46.148919 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4b47f4e7-26dd-4e94-9d48-306799e2b9e6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:46.149456 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4b47f4e7-26dd-4e94-9d48-306799e2b9e6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:46.456227 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-4b47f4e7-26dd-4e94-9d48-306799e2b9e6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:46.467705 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-4b47f4e7-26dd-4e94-9d48-306799e2b9e6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:46.470833 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-4b47f4e7-26dd-4e94-9d48-306799e2b9e6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:46.474780 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-4b47f4e7-26dd-4e94-9d48-306799e2b9e6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1724 microversion: 2.20 time: 0.337080 Jun 17 08:53:46.474780 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 108/217] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:53:46 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1724 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:53:47.092665 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-e9a6f215-1ebe-4af3-be7b-07c661f91b2a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:47.093446 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-e9a6f215-1ebe-4af3-be7b-07c661f91b2a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:47.100041 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e9a6f215-1ebe-4af3-be7b-07c661f91b2a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:47.101439 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e9a6f215-1ebe-4af3-be7b-07c661f91b2a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:47.101439 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e9a6f215-1ebe-4af3-be7b-07c661f91b2a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:47.102532 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e9a6f215-1ebe-4af3-be7b-07c661f91b2a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:47.280466 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-e9a6f215-1ebe-4af3-be7b-07c661f91b2a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:47.288578 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-e9a6f215-1ebe-4af3-be7b-07c661f91b2a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.199998 Jun 17 08:53:47.289568 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 110/218] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:47 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:47.492897 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-ac525ace-a96a-4ff9-a14d-5c0a33586e40 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:47.493600 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-ac525ace-a96a-4ff9-a14d-5c0a33586e40 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:47.500283 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ac525ace-a96a-4ff9-a14d-5c0a33586e40 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:47.500736 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ac525ace-a96a-4ff9-a14d-5c0a33586e40 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:47.501522 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ac525ace-a96a-4ff9-a14d-5c0a33586e40 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:47.501960 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ac525ace-a96a-4ff9-a14d-5c0a33586e40 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:47.687575 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-ac525ace-a96a-4ff9-a14d-5c0a33586e40 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:47.701155 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-ac525ace-a96a-4ff9-a14d-5c0a33586e40 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:47.702833 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-ac525ace-a96a-4ff9-a14d-5c0a33586e40 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:47.704162 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-ac525ace-a96a-4ff9-a14d-5c0a33586e40 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1724 microversion: 2.20 time: 0.215906 Jun 17 08:53:47.704907 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 109/219] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:53:47 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:53:48.306880 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0bf3abe5-792a-4057-adde-c43f43ef52e3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:48.307792 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0bf3abe5-792a-4057-adde-c43f43ef52e3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:48.318376 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0bf3abe5-792a-4057-adde-c43f43ef52e3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:48.322455 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0bf3abe5-792a-4057-adde-c43f43ef52e3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:48.325491 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0bf3abe5-792a-4057-adde-c43f43ef52e3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:48.326097 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0bf3abe5-792a-4057-adde-c43f43ef52e3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:48.542698 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0bf3abe5-792a-4057-adde-c43f43ef52e3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:48.551140 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0bf3abe5-792a-4057-adde-c43f43ef52e3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.248955 Jun 17 08:53:48.552508 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 111/220] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:48 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:48.805882 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e2956ade-a33a-485c-b2a4-38ada79b330d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:48.805882 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-e2956ade-a33a-485c-b2a4-38ada79b330d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:48.805882 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e2956ade-a33a-485c-b2a4-38ada79b330d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:48.805882 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e2956ade-a33a-485c-b2a4-38ada79b330d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:48.807491 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e2956ade-a33a-485c-b2a4-38ada79b330d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:48.807491 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e2956ade-a33a-485c-b2a4-38ada79b330d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:48.963265 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e2956ade-a33a-485c-b2a4-38ada79b330d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:48.974756 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e2956ade-a33a-485c-b2a4-38ada79b330d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:48.979161 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e2956ade-a33a-485c-b2a4-38ada79b330d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:48.981678 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-e2956ade-a33a-485c-b2a4-38ada79b330d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1724 microversion: 2.20 time: 0.262113 Jun 17 08:53:48.982441 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 110/221] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:53:48 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:53:49.578383 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-2519a967-4871-4b8c-b494-daead33975fd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:49.579717 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-2519a967-4871-4b8c-b494-daead33975fd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:49.593507 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2519a967-4871-4b8c-b494-daead33975fd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:49.596063 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2519a967-4871-4b8c-b494-daead33975fd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:49.599595 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2519a967-4871-4b8c-b494-daead33975fd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:49.600824 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2519a967-4871-4b8c-b494-daead33975fd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:49.973248 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2519a967-4871-4b8c-b494-daead33975fd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:49.981750 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-2519a967-4871-4b8c-b494-daead33975fd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.414400 Jun 17 08:53:49.982333 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 112/222] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:49 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:50.004744 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-0240b82c-f9ea-4499-845b-03455dc19e69 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:50.006220 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-0240b82c-f9ea-4499-845b-03455dc19e69 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:50.015540 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0240b82c-f9ea-4499-845b-03455dc19e69 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:50.016214 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0240b82c-f9ea-4499-845b-03455dc19e69 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:50.017350 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0240b82c-f9ea-4499-845b-03455dc19e69 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:50.019121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0240b82c-f9ea-4499-845b-03455dc19e69 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:50.519460 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-0240b82c-f9ea-4499-845b-03455dc19e69 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:50.526388 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-0240b82c-f9ea-4499-845b-03455dc19e69 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:50.531217 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-0240b82c-f9ea-4499-845b-03455dc19e69 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:50.533784 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-0240b82c-f9ea-4499-845b-03455dc19e69 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1724 microversion: 2.20 time: 0.536769 Jun 17 08:53:50.535532 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 111/223] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:53:49 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1724 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:53:51.003109 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-9143e7ab-d2b3-403a-bb5d-5ec93a50b7c8 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:51.006126 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-9143e7ab-d2b3-403a-bb5d-5ec93a50b7c8 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:51.013024 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9143e7ab-d2b3-403a-bb5d-5ec93a50b7c8 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:51.013587 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9143e7ab-d2b3-403a-bb5d-5ec93a50b7c8 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:51.014469 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9143e7ab-d2b3-403a-bb5d-5ec93a50b7c8 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:51.014985 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9143e7ab-d2b3-403a-bb5d-5ec93a50b7c8 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:51.221579 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-9143e7ab-d2b3-403a-bb5d-5ec93a50b7c8 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:51.231999 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-9143e7ab-d2b3-403a-bb5d-5ec93a50b7c8 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.236977 Jun 17 08:53:51.232661 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 113/224] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:50 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:51.552850 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-5af991b8-88bd-4267-b739-e28f3050bd67 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:51.553574 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-5af991b8-88bd-4267-b739-e28f3050bd67 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:51.571143 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5af991b8-88bd-4267-b739-e28f3050bd67 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:51.571668 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5af991b8-88bd-4267-b739-e28f3050bd67 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:51.572462 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5af991b8-88bd-4267-b739-e28f3050bd67 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:51.572902 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5af991b8-88bd-4267-b739-e28f3050bd67 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:51.591300 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:51.815765 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-5af991b8-88bd-4267-b739-e28f3050bd67 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:51.825994 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-5af991b8-88bd-4267-b739-e28f3050bd67 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:51.831920 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-5af991b8-88bd-4267-b739-e28f3050bd67 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:51.833496 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-5af991b8-88bd-4267-b739-e28f3050bd67 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1724 microversion: 2.20 time: 0.284456 Jun 17 08:53:51.834286 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 112/225] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:53:51 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:53:52.249612 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-54cb4aaf-33f2-4f9e-9e61-46a955798f2e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:52.252007 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-54cb4aaf-33f2-4f9e-9e61-46a955798f2e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:52.260006 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-54cb4aaf-33f2-4f9e-9e61-46a955798f2e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:52.262645 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-54cb4aaf-33f2-4f9e-9e61-46a955798f2e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:52.262645 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-54cb4aaf-33f2-4f9e-9e61-46a955798f2e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:52.262645 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-54cb4aaf-33f2-4f9e-9e61-46a955798f2e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:52.482338 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-54cb4aaf-33f2-4f9e-9e61-46a955798f2e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:52.491328 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-54cb4aaf-33f2-4f9e-9e61-46a955798f2e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.245198 Jun 17 08:53:52.491972 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 114/226] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:52 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:53:52.857454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-75b80613-e4a4-47fe-8705-8772683b13db tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:52.857454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-75b80613-e4a4-47fe-8705-8772683b13db tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:52.861357 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-75b80613-e4a4-47fe-8705-8772683b13db tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:52.861815 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-75b80613-e4a4-47fe-8705-8772683b13db tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:52.862601 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-75b80613-e4a4-47fe-8705-8772683b13db tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:52.863054 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-75b80613-e4a4-47fe-8705-8772683b13db tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:53.053551 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-75b80613-e4a4-47fe-8705-8772683b13db tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:53.062775 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-75b80613-e4a4-47fe-8705-8772683b13db tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:53.064311 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-75b80613-e4a4-47fe-8705-8772683b13db tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:53.065475 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-75b80613-e4a4-47fe-8705-8772683b13db tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1724 microversion: 2.20 time: 0.217139 Jun 17 08:53:53.066037 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 113/227] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:53:52 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:53:53.523137 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-c121c32d-653a-45e7-9e4f-cf8d07cac66b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:53.536907 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-c121c32d-653a-45e7-9e4f-cf8d07cac66b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:53.543882 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c121c32d-653a-45e7-9e4f-cf8d07cac66b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:53.544443 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c121c32d-653a-45e7-9e4f-cf8d07cac66b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:53.545231 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c121c32d-653a-45e7-9e4f-cf8d07cac66b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:53.545720 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c121c32d-653a-45e7-9e4f-cf8d07cac66b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:53.740893 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c121c32d-653a-45e7-9e4f-cf8d07cac66b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:53.750541 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-c121c32d-653a-45e7-9e4f-cf8d07cac66b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.231467 Jun 17 08:53:53.751149 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 115/228] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:53 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:54.087760 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-4a2ca220-0931-482e-8d40-3301f71b6001 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:54.093179 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-4a2ca220-0931-482e-8d40-3301f71b6001 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:54.125781 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4a2ca220-0931-482e-8d40-3301f71b6001 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:54.126181 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4a2ca220-0931-482e-8d40-3301f71b6001 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:54.127788 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4a2ca220-0931-482e-8d40-3301f71b6001 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:54.128127 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4a2ca220-0931-482e-8d40-3301f71b6001 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:54.295916 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-4a2ca220-0931-482e-8d40-3301f71b6001 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:54.304759 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-4a2ca220-0931-482e-8d40-3301f71b6001 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:54.307610 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-4a2ca220-0931-482e-8d40-3301f71b6001 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:54.309515 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-4a2ca220-0931-482e-8d40-3301f71b6001 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1724 microversion: 2.20 time: 0.228860 Jun 17 08:53:54.310061 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 114/229] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:53:54 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:53:54.776826 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-5c3d7189-3454-400f-ae9b-4ae474454786 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:54.777439 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-5c3d7189-3454-400f-ae9b-4ae474454786 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:54.795766 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5c3d7189-3454-400f-ae9b-4ae474454786 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:54.796230 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5c3d7189-3454-400f-ae9b-4ae474454786 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:54.797007 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5c3d7189-3454-400f-ae9b-4ae474454786 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:54.809800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5c3d7189-3454-400f-ae9b-4ae474454786 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:55.020904 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-5c3d7189-3454-400f-ae9b-4ae474454786 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:55.035914 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-5c3d7189-3454-400f-ae9b-4ae474454786 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.263231 Jun 17 08:53:55.037084 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 116/230] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:54 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:55.140283 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-5b978aa6-a076-40a0-9c29-ab59186747ea tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Action: 'create', calling method: .version_select at 0x7fbc33d37f70>, body: {"keypair": {"name": "tempest-keypair-1088158492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGTXIMYJihYyXPMWAUNjfzob0oz1o56NJh26QQzth0AEkOl4f3oIf2FIvkmM2y87QDHndOknxVT4s1F890Q2PyfowhmaksGXzeUDKRhFXmbtMq4eDnKvdopbyLwNvTEww=="}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:53:55.145495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:55.166014 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-5b978aa6-a076-40a0-9c29-ab59186747ea tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Getting quotas for project 794e7ebcf5c3436081b8e8d39907b655. Resources: {'key_pairs'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:53:55.170268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-5b978aa6-a076-40a0-9c29-ab59186747ea tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Getting quotas for user 01bb3df8b4b649388d1a0f6c24e18f1b and project 794e7ebcf5c3436081b8e8d39907b655. Resources: {'key_pairs'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:53:55.249763 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-e65f56a5-a8e1-420a-b655-bd725fbc9eb3 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2105750131", "imageRef": "978084c7-ed2c-4e42-ac8b-f5d19c4001fe", "flavorRef": "452"}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:53:55.313909 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-5b978aa6-a076-40a0-9c29-ab59186747ea tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.178137 Jun 17 08:53:55.315185 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 115/231] 10.222.0.78 () {60 vars in 1158 bytes} [Fri Jun 17 08:53:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:53:55.328487 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-32ed4c85-371c-40da-acc0-9b3c289fd200 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:55.329270 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-32ed4c85-371c-40da-acc0-9b3c289fd200 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:55.340308 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-32ed4c85-371c-40da-acc0-9b3c289fd200 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:55.341211 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-32ed4c85-371c-40da-acc0-9b3c289fd200 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:55.342208 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-32ed4c85-371c-40da-acc0-9b3c289fd200 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:55.342942 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-32ed4c85-371c-40da-acc0-9b3c289fd200 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:55.779303 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-32ed4c85-371c-40da-acc0-9b3c289fd200 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:55.788206 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-32ed4c85-371c-40da-acc0-9b3c289fd200 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:55.790568 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-32ed4c85-371c-40da-acc0-9b3c289fd200 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:55.792217 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-32ed4c85-371c-40da-acc0-9b3c289fd200 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1724 microversion: 2.20 time: 0.468266 Jun 17 08:53:55.803462 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 116/232] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:53:55 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1724 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:53:56.054704 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a7f384ef-e1eb-4180-b72c-6dbff284de3b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:56.059826 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a7f384ef-e1eb-4180-b72c-6dbff284de3b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:56.066230 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a7f384ef-e1eb-4180-b72c-6dbff284de3b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:56.066688 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a7f384ef-e1eb-4180-b72c-6dbff284de3b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:56.067504 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a7f384ef-e1eb-4180-b72c-6dbff284de3b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:56.067948 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a7f384ef-e1eb-4180-b72c-6dbff284de3b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:56.286334 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.network.neutron [None req-e65f56a5-a8e1-420a-b655-bd725fbc9eb3 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] validate_networks() for None {{(pid=129875) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:53:56.372642 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a7f384ef-e1eb-4180-b72c-6dbff284de3b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:56.382153 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a7f384ef-e1eb-4180-b72c-6dbff284de3b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.331522 Jun 17 08:53:56.382752 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 117/233] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:56 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:56.655969 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-e65f56a5-a8e1-420a-b655-bd725fbc9eb3 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Flavor limits 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:53:56.656400 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-e65f56a5-a8e1-420a-b655-bd725fbc9eb3 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Image limits 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:53:56.656902 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-e65f56a5-a8e1-420a-b655-bd725fbc9eb3 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Flavor pref 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:53:56.657324 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-e65f56a5-a8e1-420a-b655-bd725fbc9eb3 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Image pref 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:53:56.657743 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-e65f56a5-a8e1-420a-b655-bd725fbc9eb3 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:53:56.660161 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=56 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:56.669456 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e65f56a5-a8e1-420a-b655-bd725fbc9eb3 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:56.669906 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e65f56a5-a8e1-420a-b655-bd725fbc9eb3 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:56.670705 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e65f56a5-a8e1-420a-b655-bd725fbc9eb3 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:56.671140 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e65f56a5-a8e1-420a-b655-bd725fbc9eb3 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:56.690695 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-e65f56a5-a8e1-420a-b655-bd725fbc9eb3 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Getting quotas for project f5809f2e310d4768acbf28fb54280f35. Resources: {'ram', 'cores', 'instances'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:53:56.737713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-e65f56a5-a8e1-420a-b655-bd725fbc9eb3 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Getting quotas for user 8885e2308ed64b52afcb6b6e6b67bffe and project f5809f2e310d4768acbf28fb54280f35. Resources: {'ram', 'cores', 'instances'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:53:56.737713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-e65f56a5-a8e1-420a-b655-bd725fbc9eb3 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Going to run 1 instances... {{(pid=129875) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:53:56.737713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-e65f56a5-a8e1-420a-b655-bd725fbc9eb3 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='978084c7-ed2c-4e42-ac8b-f5d19c4001fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:53:56.810708 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-bf146721-a4aa-4df3-922c-fe0d472e7f0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:56.811330 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-bf146721-a4aa-4df3-922c-fe0d472e7f0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:56.817928 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bf146721-a4aa-4df3-922c-fe0d472e7f0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:56.818515 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bf146721-a4aa-4df3-922c-fe0d472e7f0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:56.819314 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bf146721-a4aa-4df3-922c-fe0d472e7f0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:56.819781 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bf146721-a4aa-4df3-922c-fe0d472e7f0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:57.127098 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-bf146721-a4aa-4df3-922c-fe0d472e7f0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:57.137640 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-bf146721-a4aa-4df3-922c-fe0d472e7f0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:57.142074 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-bf146721-a4aa-4df3-922c-fe0d472e7f0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:57.143924 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-bf146721-a4aa-4df3-922c-fe0d472e7f0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1724 microversion: 2.20 time: 0.337487 Jun 17 08:53:57.148269 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 118/234] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:53:56 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1724 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:53:57.297505 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-e65f56a5-a8e1-420a-b655-bd725fbc9eb3 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.051599 Jun 17 08:53:57.303836 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 117/235] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jun 17 08:53:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 17 08:53:57.309065 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-9b262585-0412-469c-8445-1bb93914f8e7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:57.310407 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-9b262585-0412-469c-8445-1bb93914f8e7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:57.400721 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-75361349-cc41-4fc3-ac63-4c913114c349 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:57.401727 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-75361349-cc41-4fc3-ac63-4c913114c349 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:57.408807 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-75361349-cc41-4fc3-ac63-4c913114c349 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:57.412944 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-75361349-cc41-4fc3-ac63-4c913114c349 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:57.412944 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-75361349-cc41-4fc3-ac63-4c913114c349 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:57.412944 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-75361349-cc41-4fc3-ac63-4c913114c349 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:57.420485 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-9b262585-0412-469c-8445-1bb93914f8e7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:57.429486 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-9b262585-0412-469c-8445-1bb93914f8e7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1215 microversion: 2.1 time: 0.125050 Jun 17 08:53:57.440954 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 119/236] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:57 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1215 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:53:57.611961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-75361349-cc41-4fc3-ac63-4c913114c349 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:57.621517 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-75361349-cc41-4fc3-ac63-4c913114c349 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.224727 Jun 17 08:53:57.622485 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 118/237] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:57 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:53:58.170961 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-4782189b-e70e-4c41-81c5-a88dc0696125 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:58.172162 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-4782189b-e70e-4c41-81c5-a88dc0696125 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:58.183846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4782189b-e70e-4c41-81c5-a88dc0696125 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:58.184955 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4782189b-e70e-4c41-81c5-a88dc0696125 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:58.185939 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4782189b-e70e-4c41-81c5-a88dc0696125 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:58.186523 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4782189b-e70e-4c41-81c5-a88dc0696125 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:58.408012 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-4782189b-e70e-4c41-81c5-a88dc0696125 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:58.423916 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-4782189b-e70e-4c41-81c5-a88dc0696125 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:58.426306 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-4782189b-e70e-4c41-81c5-a88dc0696125 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:58.428039 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-4782189b-e70e-4c41-81c5-a88dc0696125 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1724 microversion: 2.20 time: 0.260905 Jun 17 08:53:58.438552 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 120/238] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:53:58 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:53:58.450609 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-83a3883e-e7e7-4009-9dc2-83d059544d83 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:58.451062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-83a3883e-e7e7-4009-9dc2-83d059544d83 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:58.523747 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-83a3883e-e7e7-4009-9dc2-83d059544d83 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:58.531908 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-83a3883e-e7e7-4009-9dc2-83d059544d83 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1215 microversion: 2.1 time: 0.086719 Jun 17 08:53:58.541451 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 119/239] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:58 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:58.640968 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-4a9b548e-a928-47cc-aa02-29ee743860d5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:58.643154 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-4a9b548e-a928-47cc-aa02-29ee743860d5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:58.652735 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4a9b548e-a928-47cc-aa02-29ee743860d5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:58.653559 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4a9b548e-a928-47cc-aa02-29ee743860d5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:58.654500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4a9b548e-a928-47cc-aa02-29ee743860d5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:58.654968 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4a9b548e-a928-47cc-aa02-29ee743860d5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:58.890680 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-4a9b548e-a928-47cc-aa02-29ee743860d5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:58.899211 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-4a9b548e-a928-47cc-aa02-29ee743860d5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.262839 Jun 17 08:53:58.910528 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 121/240] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:58 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:59.449978 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-6c3604d7-89dd-4f2d-8b3a-bfa9fe982431 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1749316932", "imageRef": "978084c7-ed2c-4e42-ac8b-f5d19c4001fe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5af04e5-5681-4034-bf01-a7f9807128a2"}], "security_groups": [{"name": "tempest-securitygroup--718827815"}], "key_name": "tempest-keypair-1088158492", "user_data": "}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:53:59.451167 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-236de633-6d1e-4411-a428-70b75d88cb0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:59.452302 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-236de633-6d1e-4411-a428-70b75d88cb0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:59.480157 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-236de633-6d1e-4411-a428-70b75d88cb0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:59.481079 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-236de633-6d1e-4411-a428-70b75d88cb0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:59.482098 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-236de633-6d1e-4411-a428-70b75d88cb0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:59.484059 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-236de633-6d1e-4411-a428-70b75d88cb0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:59.663958 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.network.neutron [None req-6c3604d7-89dd-4f2d-8b3a-bfa9fe982431 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] validate_networks() for [('b5af04e5-5681-4034-bf01-a7f9807128a2', None, None, None, None, None)] {{(pid=129875) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:53:59.722730 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-236de633-6d1e-4411-a428-70b75d88cb0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:59.740687 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-236de633-6d1e-4411-a428-70b75d88cb0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:59.741658 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-236de633-6d1e-4411-a428-70b75d88cb0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:59.743101 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-236de633-6d1e-4411-a428-70b75d88cb0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1745 microversion: 2.20 time: 0.301141 Jun 17 08:53:59.743997 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 122/241] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:53:59 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1745 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:53:59.760259 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-06eac91d-4f59-471e-a65e-2bafb2f5cf80 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:59.760884 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-06eac91d-4f59-471e-a65e-2bafb2f5cf80 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:59.768490 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-06eac91d-4f59-471e-a65e-2bafb2f5cf80 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:59.775044 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-06eac91d-4f59-471e-a65e-2bafb2f5cf80 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:59.775044 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-06eac91d-4f59-471e-a65e-2bafb2f5cf80 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:59.775044 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-06eac91d-4f59-471e-a65e-2bafb2f5cf80 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:59.873696 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-06eac91d-4f59-471e-a65e-2bafb2f5cf80 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:59.884305 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-06eac91d-4f59-471e-a65e-2bafb2f5cf80 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1267 microversion: 2.1 time: 0.138384 Jun 17 08:53:59.886730 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 123/242] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:59 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:59.918798 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-0eda8586-d82c-4849-a344-35fe0b81ca9c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:59.919454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-0eda8586-d82c-4849-a344-35fe0b81ca9c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:59.926824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0eda8586-d82c-4849-a344-35fe0b81ca9c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:59.927302 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0eda8586-d82c-4849-a344-35fe0b81ca9c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:59.928139 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0eda8586-d82c-4849-a344-35fe0b81ca9c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:59.928579 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0eda8586-d82c-4849-a344-35fe0b81ca9c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:00.291296 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-0eda8586-d82c-4849-a344-35fe0b81ca9c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:00.306104 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-0eda8586-d82c-4849-a344-35fe0b81ca9c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.392540 Jun 17 08:54:00.307189 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 124/243] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:59 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:00.348602 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-6c3604d7-89dd-4f2d-8b3a-bfa9fe982431 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Flavor limits 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:54:00.349030 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-6c3604d7-89dd-4f2d-8b3a-bfa9fe982431 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Image limits 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:54:00.349682 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-6c3604d7-89dd-4f2d-8b3a-bfa9fe982431 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Flavor pref 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:54:00.350315 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-6c3604d7-89dd-4f2d-8b3a-bfa9fe982431 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Image pref 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:54:00.350736 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-6c3604d7-89dd-4f2d-8b3a-bfa9fe982431 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:54:00.361198 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6c3604d7-89dd-4f2d-8b3a-bfa9fe982431 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:00.367131 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6c3604d7-89dd-4f2d-8b3a-bfa9fe982431 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:00.367131 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6c3604d7-89dd-4f2d-8b3a-bfa9fe982431 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:00.367131 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6c3604d7-89dd-4f2d-8b3a-bfa9fe982431 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:00.397426 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-6c3604d7-89dd-4f2d-8b3a-bfa9fe982431 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Getting quotas for project 794e7ebcf5c3436081b8e8d39907b655. Resources: {'ram', 'cores', 'instances'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:54:00.404560 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-6c3604d7-89dd-4f2d-8b3a-bfa9fe982431 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Getting quotas for user 01bb3df8b4b649388d1a0f6c24e18f1b and project 794e7ebcf5c3436081b8e8d39907b655. Resources: {'ram', 'cores', 'instances'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:54:00.417441 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-6c3604d7-89dd-4f2d-8b3a-bfa9fe982431 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Going to run 1 instances... {{(pid=129875) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:54:00.419933 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-6c3604d7-89dd-4f2d-8b3a-bfa9fe982431 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='978084c7-ed2c-4e42-ac8b-f5d19c4001fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:54:00.764928 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-9361fcab-ea57-4c48-b5bb-40f064816eb4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:00.765548 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-9361fcab-ea57-4c48-b5bb-40f064816eb4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:00.772608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9361fcab-ea57-4c48-b5bb-40f064816eb4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:00.773096 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9361fcab-ea57-4c48-b5bb-40f064816eb4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:00.773903 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9361fcab-ea57-4c48-b5bb-40f064816eb4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:00.774330 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9361fcab-ea57-4c48-b5bb-40f064816eb4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:00.931220 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-9361fcab-ea57-4c48-b5bb-40f064816eb4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:00.942369 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-9361fcab-ea57-4c48-b5bb-40f064816eb4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:00.944111 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-9361fcab-ea57-4c48-b5bb-40f064816eb4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:00.946000 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-9361fcab-ea57-4c48-b5bb-40f064816eb4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1745 microversion: 2.20 time: 0.186508 Jun 17 08:54:00.947147 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 125/244] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:00 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1745 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:54:00.957054 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-0e5852bf-aab2-458e-be99-3bf9a785cecf tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:00.958239 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-0e5852bf-aab2-458e-be99-3bf9a785cecf tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:00.965652 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0e5852bf-aab2-458e-be99-3bf9a785cecf tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:00.966112 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0e5852bf-aab2-458e-be99-3bf9a785cecf tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:00.966943 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0e5852bf-aab2-458e-be99-3bf9a785cecf tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:00.967417 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0e5852bf-aab2-458e-be99-3bf9a785cecf tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:01.043407 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-0e5852bf-aab2-458e-be99-3bf9a785cecf tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:01.054325 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-0e5852bf-aab2-458e-be99-3bf9a785cecf tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1275 microversion: 2.1 time: 0.102630 Jun 17 08:54:01.054979 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 126/245] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:00 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1275 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:01.165793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-6c3604d7-89dd-4f2d-8b3a-bfa9fe982431 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.724798 Jun 17 08:54:01.167043 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 120/246] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jun 17 08:53:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 1727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:54:01.182605 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-0f2c219a-8f05-4cff-be3e-cb6cc9b3527b tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:01.183230 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-0f2c219a-8f05-4cff-be3e-cb6cc9b3527b tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:01.258923 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-0f2c219a-8f05-4cff-be3e-cb6cc9b3527b tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:01.267237 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-0f2c219a-8f05-4cff-be3e-cb6cc9b3527b tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1242 microversion: 2.1 time: 0.089510 Jun 17 08:54:01.269161 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 127/247] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:01 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:01.337042 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1b517cd8-7e2b-498b-b758-89a0b62596d0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:01.338687 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-1b517cd8-7e2b-498b-b758-89a0b62596d0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:01.349607 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1b517cd8-7e2b-498b-b758-89a0b62596d0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:01.360563 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1b517cd8-7e2b-498b-b758-89a0b62596d0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:01.360563 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1b517cd8-7e2b-498b-b758-89a0b62596d0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:01.360563 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1b517cd8-7e2b-498b-b758-89a0b62596d0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:01.594257 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-1b517cd8-7e2b-498b-b758-89a0b62596d0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:01.604769 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-1b517cd8-7e2b-498b-b758-89a0b62596d0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.273357 Jun 17 08:54:01.606016 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 121/248] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:01 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:01.965240 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a19fd420-6104-440c-89f8-bdccb1bfafe1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:01.965861 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a19fd420-6104-440c-89f8-bdccb1bfafe1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:01.973199 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a19fd420-6104-440c-89f8-bdccb1bfafe1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:01.973653 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a19fd420-6104-440c-89f8-bdccb1bfafe1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:01.974447 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a19fd420-6104-440c-89f8-bdccb1bfafe1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:01.974870 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a19fd420-6104-440c-89f8-bdccb1bfafe1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:02.073195 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-6eaed2fa-1645-4312-bebb-1287aadc931a tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:02.074095 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-6eaed2fa-1645-4312-bebb-1287aadc931a tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:02.084072 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6eaed2fa-1645-4312-bebb-1287aadc931a tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:02.085138 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6eaed2fa-1645-4312-bebb-1287aadc931a tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:02.085928 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6eaed2fa-1645-4312-bebb-1287aadc931a tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:02.087009 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6eaed2fa-1645-4312-bebb-1287aadc931a tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:02.093667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:02.185633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a19fd420-6104-440c-89f8-bdccb1bfafe1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:02.213991 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a19fd420-6104-440c-89f8-bdccb1bfafe1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:02.216172 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a19fd420-6104-440c-89f8-bdccb1bfafe1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:02.218469 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a19fd420-6104-440c-89f8-bdccb1bfafe1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1745 microversion: 2.20 time: 0.257066 Jun 17 08:54:02.230787 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 128/249] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:01 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1745 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:02.295868 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-80ded7f7-daf8-459c-8205-ba2ab918efcb tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:02.297026 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-80ded7f7-daf8-459c-8205-ba2ab918efcb tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:02.308344 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-6eaed2fa-1645-4312-bebb-1287aadc931a tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:02.321470 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-6eaed2fa-1645-4312-bebb-1287aadc931a tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1315 microversion: 2.1 time: 0.251937 Jun 17 08:54:02.322052 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 122/250] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:02 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:02.401308 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-80ded7f7-daf8-459c-8205-ba2ab918efcb tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:02.415127 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-80ded7f7-daf8-459c-8205-ba2ab918efcb tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1242 microversion: 2.1 time: 0.126496 Jun 17 08:54:02.417872 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 129/251] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:02 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1242 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:02.506496 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-25336789-6d7e-41ce-9aeb-fbd4ec452ba4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Action: 'create', calling method: .version_select at 0x7fbc405da550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1430171894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWYKXgxhpurjRzQPuwrEqHrPiKPqCt9gU7hzsIRyjY/dvwbxIFIhNC3vvZKnk/Hh5PsIydTfHv/XyEcQNU0aeSOJpLMDpKg6/LaolwL1/+kNLjdbrXtGNWZ2E8EGRgCtQ=="}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:54:02.523330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-25336789-6d7e-41ce-9aeb-fbd4ec452ba4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Getting quotas for project 45a0a44acc444e8eb9bba54a8e089f17. Resources: {'key_pairs'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:54:02.542701 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-25336789-6d7e-41ce-9aeb-fbd4ec452ba4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Getting quotas for user b9ab8c84c68b4275b2f81b69d8a52826 and project 45a0a44acc444e8eb9bba54a8e089f17. Resources: {'key_pairs'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:54:02.624487 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-9e1a65db-9daa-41cb-a0f1-a22371bfc15e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:02.625491 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-9e1a65db-9daa-41cb-a0f1-a22371bfc15e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:02.638193 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9e1a65db-9daa-41cb-a0f1-a22371bfc15e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:02.638193 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9e1a65db-9daa-41cb-a0f1-a22371bfc15e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:02.638193 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9e1a65db-9daa-41cb-a0f1-a22371bfc15e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:02.638193 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9e1a65db-9daa-41cb-a0f1-a22371bfc15e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:02.685188 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-25336789-6d7e-41ce-9aeb-fbd4ec452ba4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.182895 Jun 17 08:54:02.690404 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 123/252] 10.222.0.78 () {60 vars in 1158 bytes} [Fri Jun 17 08:54:02 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:54:02.695077 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-426b2b3d-74f7-4bd3-bf17-fb4ce79abfb2 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1854054491", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1164176646", "security_groups": [{"name": "tempest-secgroup-smoke-992696564"}], "networks": [{"uuid": "7cb290e5-1940-4a89-abd7-919a1f5a901c"}], "block_device_mapping_v2": [{"uuid": "9d19666e-2f25-41e9-9fe8-411d8cefdcd7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:54:02.884470 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-9e1a65db-9daa-41cb-a0f1-a22371bfc15e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:02.894549 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-9e1a65db-9daa-41cb-a0f1-a22371bfc15e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.274278 Jun 17 08:54:02.899214 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 130/253] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:02 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:02.912611 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-2ea4e5d9-240d-4a64-9b41-7ffc2e8a0aa4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1399115727", "imageRef": "e1d987ff-9250-4f94-9911-ecd508bb8ad3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1430171894", "networks": [{"uuid": "7d9f1082-9521-43ef-8a03-308b31da632e"}]}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:54:02.950960 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.network.neutron [None req-426b2b3d-74f7-4bd3-bf17-fb4ce79abfb2 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] validate_networks() for [('7cb290e5-1940-4a89-abd7-919a1f5a901c', None, None, None, None, None)] {{(pid=129875) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:54:02.979589 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.network.neutron [None req-2ea4e5d9-240d-4a64-9b41-7ffc2e8a0aa4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] validate_networks() for [('7d9f1082-9521-43ef-8a03-308b31da632e', None, None, None, None, None)] {{(pid=129876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:54:03.643728 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-426b2b3d-74f7-4bd3-bf17-fb4ce79abfb2 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Flavor limits 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:54:03.644989 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-426b2b3d-74f7-4bd3-bf17-fb4ce79abfb2 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Image limits 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:54:03.645667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-426b2b3d-74f7-4bd3-bf17-fb4ce79abfb2 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Flavor pref 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:54:03.646571 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-426b2b3d-74f7-4bd3-bf17-fb4ce79abfb2 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Image pref 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:54:03.647993 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-426b2b3d-74f7-4bd3-bf17-fb4ce79abfb2 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:54:03.659982 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-426b2b3d-74f7-4bd3-bf17-fb4ce79abfb2 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:03.660441 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-426b2b3d-74f7-4bd3-bf17-fb4ce79abfb2 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:03.661258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-426b2b3d-74f7-4bd3-bf17-fb4ce79abfb2 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:03.661705 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-426b2b3d-74f7-4bd3-bf17-fb4ce79abfb2 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:03.696551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-426b2b3d-74f7-4bd3-bf17-fb4ce79abfb2 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Getting quotas for project 7e69cf14c3c8482fbf95620efe1bee1d. Resources: {'ram', 'cores', 'instances'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:54:03.704815 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-426b2b3d-74f7-4bd3-bf17-fb4ce79abfb2 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Getting quotas for user fec25ac241c94d4dbebb361c55f10f75 and project 7e69cf14c3c8482fbf95620efe1bee1d. Resources: {'ram', 'cores', 'instances'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:54:03.788546 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-426b2b3d-74f7-4bd3-bf17-fb4ce79abfb2 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Going to run 1 instances... {{(pid=129875) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:54:03.791245 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-426b2b3d-74f7-4bd3-bf17-fb4ce79abfb2 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9d19666e-2f25-41e9-9fe8-411d8cefdcd7',volume_size=None,volume_type=None)] {{(pid=129875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:54:03.872723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-2ea4e5d9-240d-4a64-9b41-7ffc2e8a0aa4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Flavor limits 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:54:03.873380 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-2ea4e5d9-240d-4a64-9b41-7ffc2e8a0aa4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Image limits 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:54:03.873863 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-2ea4e5d9-240d-4a64-9b41-7ffc2e8a0aa4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Flavor pref 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:54:03.874307 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-2ea4e5d9-240d-4a64-9b41-7ffc2e8a0aa4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Image pref 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:54:03.874726 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-2ea4e5d9-240d-4a64-9b41-7ffc2e8a0aa4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:54:03.886221 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2ea4e5d9-240d-4a64-9b41-7ffc2e8a0aa4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:03.887458 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2ea4e5d9-240d-4a64-9b41-7ffc2e8a0aa4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:03.888325 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2ea4e5d9-240d-4a64-9b41-7ffc2e8a0aa4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:03.888771 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2ea4e5d9-240d-4a64-9b41-7ffc2e8a0aa4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:03.906995 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-2ea4e5d9-240d-4a64-9b41-7ffc2e8a0aa4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Getting quotas for project 45a0a44acc444e8eb9bba54a8e089f17. Resources: {'ram', 'cores', 'instances'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:54:03.913125 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-2ea4e5d9-240d-4a64-9b41-7ffc2e8a0aa4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Getting quotas for user b9ab8c84c68b4275b2f81b69d8a52826 and project 45a0a44acc444e8eb9bba54a8e089f17. Resources: {'ram', 'cores', 'instances'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:54:03.925490 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-2ea4e5d9-240d-4a64-9b41-7ffc2e8a0aa4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Going to run 1 instances... {{(pid=129876) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:54:03.927794 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-2ea4e5d9-240d-4a64-9b41-7ffc2e8a0aa4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1d987ff-9250-4f94-9911-ecd508bb8ad3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:54:04.098666 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-2ea4e5d9-240d-4a64-9b41-7ffc2e8a0aa4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.198149 Jun 17 08:54:04.099312 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 131/254] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jun 17 08:54:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:54:04.105886 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-afee04f7-af73-44de-9d86-122e5505279c req-84f2896b-0340-4c04-9844-53915132ace0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397d996b-b163-4a47-856e-f2aca2ae6976", "name": "network-vif-plugged", "status": "completed", "tag": "051f4b45-cbb1-44c1-92a3-54becef75c28"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:54:04.117851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-afee04f7-af73-44de-9d86-122e5505279c req-84f2896b-0340-4c04-9844-53915132ace0 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:04.121008 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-afee04f7-af73-44de-9d86-122e5505279c req-84f2896b-0340-4c04-9844-53915132ace0 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:04.145466 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-afee04f7-af73-44de-9d86-122e5505279c req-84f2896b-0340-4c04-9844-53915132ace0 service nova] Creating event network-vif-plugged:051f4b45-cbb1-44c1-92a3-54becef75c28 for instance 397d996b-b163-4a47-856e-f2aca2ae6976 on hv-cinder-79760 Jun 17 08:54:04.151078 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-afee04f7-af73-44de-9d86-122e5505279c req-84f2896b-0340-4c04-9844-53915132ace0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050128 Jun 17 08:54:04.152131 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 132/255] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:54:04.158084 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-c343dcb8-62fc-46b0-9987-9ac4025a0546 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:04.158784 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-c343dcb8-62fc-46b0-9987-9ac4025a0546 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:04.165400 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c343dcb8-62fc-46b0-9987-9ac4025a0546 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:04.167630 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c343dcb8-62fc-46b0-9987-9ac4025a0546 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:04.167630 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c343dcb8-62fc-46b0-9987-9ac4025a0546 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:04.167630 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c343dcb8-62fc-46b0-9987-9ac4025a0546 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:04.363682 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c343dcb8-62fc-46b0-9987-9ac4025a0546 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:04.364073 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-426b2b3d-74f7-4bd3-bf17-fb4ce79abfb2 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.672992 Jun 17 08:54:04.382066 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 124/256] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jun 17 08:54:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:54:04.394514 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3dd780d9-ba70-4d39-a8c4-0be51963e4f1 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:04.394514 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-3dd780d9-ba70-4d39-a8c4-0be51963e4f1 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:04.401178 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c343dcb8-62fc-46b0-9987-9ac4025a0546 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:04.408175 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c343dcb8-62fc-46b0-9987-9ac4025a0546 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:04.412076 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3dd780d9-ba70-4d39-a8c4-0be51963e4f1 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:04.412732 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3dd780d9-ba70-4d39-a8c4-0be51963e4f1 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:04.413837 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3dd780d9-ba70-4d39-a8c4-0be51963e4f1 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:04.414934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3dd780d9-ba70-4d39-a8c4-0be51963e4f1 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:04.415206 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-c343dcb8-62fc-46b0-9987-9ac4025a0546 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1740 microversion: 2.20 time: 0.261177 Jun 17 08:54:04.421833 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 133/257] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:04 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1740 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:04.427733 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-291e0581-2fc4-49c9-84dd-e577099baa36 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:04.429082 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-291e0581-2fc4-49c9-84dd-e577099baa36 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:04.438174 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-291e0581-2fc4-49c9-84dd-e577099baa36 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:04.438678 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-291e0581-2fc4-49c9-84dd-e577099baa36 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:04.439837 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-291e0581-2fc4-49c9-84dd-e577099baa36 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:04.440469 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-291e0581-2fc4-49c9-84dd-e577099baa36 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:04.457807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=100 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:04.641206 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-291e0581-2fc4-49c9-84dd-e577099baa36 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:04.652080 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-291e0581-2fc4-49c9-84dd-e577099baa36 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1294 microversion: 2.1 time: 0.228755 Jun 17 08:54:04.652706 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 134/258] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:04 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1294 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:04.685812 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-66cd66bd-fe3e-4b55-9680-55307960f5e0 req-36fc7c59-04b7-4e2a-bc3a-9e1734bdd780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c5d606-fea9-467c-a074-2a9a1030a461", "tag": "becbd5f3-c900-4dec-a28c-cf23062ef2fb"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:54:04.702516 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-66cd66bd-fe3e-4b55-9680-55307960f5e0 req-36fc7c59-04b7-4e2a-bc3a-9e1734bdd780 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:04.702962 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-66cd66bd-fe3e-4b55-9680-55307960f5e0 req-36fc7c59-04b7-4e2a-bc3a-9e1734bdd780 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:04.738847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-66cd66bd-fe3e-4b55-9680-55307960f5e0 req-36fc7c59-04b7-4e2a-bc3a-9e1734bdd780 service nova] Creating event network-changed:becbd5f3-c900-4dec-a28c-cf23062ef2fb for instance 30c5d606-fea9-467c-a074-2a9a1030a461 on hv-cinder-79760 Jun 17 08:54:04.745627 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-66cd66bd-fe3e-4b55-9680-55307960f5e0 req-36fc7c59-04b7-4e2a-bc3a-9e1734bdd780 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090837 Jun 17 08:54:04.746480 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 135/259] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:54:04.755092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-cec45207-cc5f-4f50-9ace-c77bbec2fb5f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:04.756237 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-cec45207-cc5f-4f50-9ace-c77bbec2fb5f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:04.764041 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-cec45207-cc5f-4f50-9ace-c77bbec2fb5f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:04.764738 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-cec45207-cc5f-4f50-9ace-c77bbec2fb5f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:04.765733 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-cec45207-cc5f-4f50-9ace-c77bbec2fb5f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:04.766378 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-cec45207-cc5f-4f50-9ace-c77bbec2fb5f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:04.816875 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3dd780d9-ba70-4d39-a8c4-0be51963e4f1 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:04.828974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-3dd780d9-ba70-4d39-a8c4-0be51963e4f1 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1315 microversion: 2.1 time: 0.443405 Jun 17 08:54:04.829587 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 125/260] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:04 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:04.845472 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-35ba4cb8-31e5-4284-b830-fad4b4843487 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:04.853018 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-35ba4cb8-31e5-4284-b830-fad4b4843487 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:04.976800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-35ba4cb8-31e5-4284-b830-fad4b4843487 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:04.985161 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-35ba4cb8-31e5-4284-b830-fad4b4843487 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1259 microversion: 2.1 time: 0.150434 Jun 17 08:54:04.987658 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 126/261] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:04 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:04.993685 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3485a8b4-3ae5-478d-99c2-93dfe7b4177b tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:04.994814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-3485a8b4-3ae5-478d-99c2-93dfe7b4177b tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:05.077753 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3485a8b4-3ae5-478d-99c2-93dfe7b4177b tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:05.085356 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-3485a8b4-3ae5-478d-99c2-93dfe7b4177b tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1089 microversion: 2.1 time: 0.096475 Jun 17 08:54:05.092183 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 127/262] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:04 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1089 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:05.106441 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-cec45207-cc5f-4f50-9ace-c77bbec2fb5f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:05.114734 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-cec45207-cc5f-4f50-9ace-c77bbec2fb5f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.366838 Jun 17 08:54:05.125446 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 136/263] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:04 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:05.440313 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-b977b1fa-efb0-4706-92fb-283252df760f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:05.441206 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-b977b1fa-efb0-4706-92fb-283252df760f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:05.454544 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b977b1fa-efb0-4706-92fb-283252df760f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:05.455002 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b977b1fa-efb0-4706-92fb-283252df760f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:05.455834 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b977b1fa-efb0-4706-92fb-283252df760f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:05.457385 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b977b1fa-efb0-4706-92fb-283252df760f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:05.637906 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b977b1fa-efb0-4706-92fb-283252df760f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:05.646815 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b977b1fa-efb0-4706-92fb-283252df760f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:05.656882 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b977b1fa-efb0-4706-92fb-283252df760f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:05.659252 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-b977b1fa-efb0-4706-92fb-283252df760f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1740 microversion: 2.20 time: 0.222834 Jun 17 08:54:05.660214 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 128/264] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:05 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1740 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:05.670794 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a01a8ba1-8e9b-4ca3-8c2a-31499fa8ce19 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:05.671978 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a01a8ba1-8e9b-4ca3-8c2a-31499fa8ce19 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:05.681250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a01a8ba1-8e9b-4ca3-8c2a-31499fa8ce19 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:05.682895 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a01a8ba1-8e9b-4ca3-8c2a-31499fa8ce19 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:05.684586 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a01a8ba1-8e9b-4ca3-8c2a-31499fa8ce19 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:05.685328 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a01a8ba1-8e9b-4ca3-8c2a-31499fa8ce19 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:05.785582 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a01a8ba1-8e9b-4ca3-8c2a-31499fa8ce19 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:05.795648 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a01a8ba1-8e9b-4ca3-8c2a-31499fa8ce19 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1300 microversion: 2.1 time: 0.129879 Jun 17 08:54:05.796874 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 137/265] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:05 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1300 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:05.846495 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-54c666e0-1b40-4cd0-832a-49cca1a23344 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:05.847205 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-54c666e0-1b40-4cd0-832a-49cca1a23344 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:05.858869 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-54c666e0-1b40-4cd0-832a-49cca1a23344 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:05.859999 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-54c666e0-1b40-4cd0-832a-49cca1a23344 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:05.861296 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-54c666e0-1b40-4cd0-832a-49cca1a23344 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:05.862483 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-54c666e0-1b40-4cd0-832a-49cca1a23344 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:06.010184 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-7a27e43c-86e6-409f-8878-d6d759b78d9c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:06.010747 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-7a27e43c-86e6-409f-8878-d6d759b78d9c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:06.021298 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7a27e43c-86e6-409f-8878-d6d759b78d9c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:06.025369 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7a27e43c-86e6-409f-8878-d6d759b78d9c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:06.026425 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7a27e43c-86e6-409f-8878-d6d759b78d9c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:06.027041 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7a27e43c-86e6-409f-8878-d6d759b78d9c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:06.142791 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-7a27e43c-86e6-409f-8878-d6d759b78d9c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:06.153383 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-7a27e43c-86e6-409f-8878-d6d759b78d9c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1263 microversion: 2.1 time: 0.151715 Jun 17 08:54:06.157691 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 138/266] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:06 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:06.167146 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-b68620b7-d6b1-4fcb-987b-cda607cf5361 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:06.170888 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-b68620b7-d6b1-4fcb-987b-cda607cf5361 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:06.183508 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b68620b7-d6b1-4fcb-987b-cda607cf5361 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:06.185833 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b68620b7-d6b1-4fcb-987b-cda607cf5361 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:06.187695 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b68620b7-d6b1-4fcb-987b-cda607cf5361 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:06.188222 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b68620b7-d6b1-4fcb-987b-cda607cf5361 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:06.188835 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-54c666e0-1b40-4cd0-832a-49cca1a23344 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:06.212780 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-54c666e0-1b40-4cd0-832a-49cca1a23344 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1315 microversion: 2.1 time: 0.370374 Jun 17 08:54:06.224894 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 129/267] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:05 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:06.230605 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-b8456b28-8cc6-4a13-86f1-5b8c8ed8c7f1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:06.231550 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-b8456b28-8cc6-4a13-86f1-5b8c8ed8c7f1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:06.238607 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b8456b28-8cc6-4a13-86f1-5b8c8ed8c7f1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:06.239436 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b8456b28-8cc6-4a13-86f1-5b8c8ed8c7f1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:06.240470 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b8456b28-8cc6-4a13-86f1-5b8c8ed8c7f1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:06.241120 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b8456b28-8cc6-4a13-86f1-5b8c8ed8c7f1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:06.283995 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-b68620b7-d6b1-4fcb-987b-cda607cf5361 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:06.301700 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-b68620b7-d6b1-4fcb-987b-cda607cf5361 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1139 microversion: 2.1 time: 0.142733 Jun 17 08:54:06.308497 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 139/268] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:06 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1139 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:06.681733 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-62749de8-0e72-43b8-a9fa-4e569b607c96 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:06.682789 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-62749de8-0e72-43b8-a9fa-4e569b607c96 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:06.695238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-62749de8-0e72-43b8-a9fa-4e569b607c96 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:06.697076 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-62749de8-0e72-43b8-a9fa-4e569b607c96 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:06.699067 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-62749de8-0e72-43b8-a9fa-4e569b607c96 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:06.699764 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-62749de8-0e72-43b8-a9fa-4e569b607c96 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:06.723934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b8456b28-8cc6-4a13-86f1-5b8c8ed8c7f1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:06.735752 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-b8456b28-8cc6-4a13-86f1-5b8c8ed8c7f1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.509127 Jun 17 08:54:06.750438 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 130/269] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:06 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:06.813896 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-c16b8e05-d723-4564-9bc9-3f894e0b441c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:06.814961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-c16b8e05-d723-4564-9bc9-3f894e0b441c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:06.832345 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c16b8e05-d723-4564-9bc9-3f894e0b441c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:06.832961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c16b8e05-d723-4564-9bc9-3f894e0b441c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:06.833831 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c16b8e05-d723-4564-9bc9-3f894e0b441c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:06.834362 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c16b8e05-d723-4564-9bc9-3f894e0b441c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:06.875554 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-62749de8-0e72-43b8-a9fa-4e569b607c96 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:06.885039 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-62749de8-0e72-43b8-a9fa-4e569b607c96 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:06.886496 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-62749de8-0e72-43b8-a9fa-4e569b607c96 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:06.887799 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-62749de8-0e72-43b8-a9fa-4e569b607c96 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1740 microversion: 2.20 time: 0.213356 Jun 17 08:54:06.888664 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 140/270] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:06 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:54:06.937545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c16b8e05-d723-4564-9bc9-3f894e0b441c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:06.947112 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-c16b8e05-d723-4564-9bc9-3f894e0b441c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1300 microversion: 2.1 time: 0.136727 Jun 17 08:54:06.948273 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 131/271] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:06 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1300 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:07.190818 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-ef82e415-8bd2-4ce1-aa5f-fede95d69921 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:07.194212 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-ef82e415-8bd2-4ce1-aa5f-fede95d69921 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:07.230015 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ef82e415-8bd2-4ce1-aa5f-fede95d69921 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:07.230015 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ef82e415-8bd2-4ce1-aa5f-fede95d69921 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:07.230015 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ef82e415-8bd2-4ce1-aa5f-fede95d69921 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:07.230015 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ef82e415-8bd2-4ce1-aa5f-fede95d69921 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:07.232339 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a445f81c-3c89-4e09-b45d-60970c0f22dc tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:07.233154 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-a445f81c-3c89-4e09-b45d-60970c0f22dc tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:07.239767 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a445f81c-3c89-4e09-b45d-60970c0f22dc tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:07.240672 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a445f81c-3c89-4e09-b45d-60970c0f22dc tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:07.245126 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a445f81c-3c89-4e09-b45d-60970c0f22dc tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:07.246070 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a445f81c-3c89-4e09-b45d-60970c0f22dc tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:07.421117 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-ef82e415-8bd2-4ce1-aa5f-fede95d69921 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:07.429406 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-ef82e415-8bd2-4ce1-aa5f-fede95d69921 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1263 microversion: 2.1 time: 0.258378 Jun 17 08:54:07.433850 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 141/272] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:07 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1263 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:07.448500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-90c24128-8924-4084-b805-1c362b121b36 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:07.450466 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-90c24128-8924-4084-b805-1c362b121b36 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:07.458913 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-90c24128-8924-4084-b805-1c362b121b36 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:07.459384 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-90c24128-8924-4084-b805-1c362b121b36 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:07.460459 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-90c24128-8924-4084-b805-1c362b121b36 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:07.460910 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-90c24128-8924-4084-b805-1c362b121b36 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:07.528460 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a445f81c-3c89-4e09-b45d-60970c0f22dc tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:07.537797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-a445f81c-3c89-4e09-b45d-60970c0f22dc tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1315 microversion: 2.1 time: 0.310316 Jun 17 08:54:07.538792 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 132/273] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:07 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:07.573981 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-90c24128-8924-4084-b805-1c362b121b36 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:07.582900 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-90c24128-8924-4084-b805-1c362b121b36 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1139 microversion: 2.1 time: 0.147288 Jun 17 08:54:07.583528 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 142/274] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:07 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1139 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:07.753626 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d6fefbe7-4c0a-4935-bdd9-367f3dbdf4e0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:07.754244 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-d6fefbe7-4c0a-4935-bdd9-367f3dbdf4e0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:07.762938 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d6fefbe7-4c0a-4935-bdd9-367f3dbdf4e0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:07.763415 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d6fefbe7-4c0a-4935-bdd9-367f3dbdf4e0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:07.764367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d6fefbe7-4c0a-4935-bdd9-367f3dbdf4e0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:07.765097 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d6fefbe7-4c0a-4935-bdd9-367f3dbdf4e0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:07.906596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-7033623e-8259-48d4-8e39-b4046e81722c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:07.907887 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-7033623e-8259-48d4-8e39-b4046e81722c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:07.921090 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7033623e-8259-48d4-8e39-b4046e81722c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:07.922430 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7033623e-8259-48d4-8e39-b4046e81722c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:07.923977 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7033623e-8259-48d4-8e39-b4046e81722c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:07.924719 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7033623e-8259-48d4-8e39-b4046e81722c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:08.268956 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d6fefbe7-4c0a-4935-bdd9-367f3dbdf4e0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:08.287958 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-d6fefbe7-4c0a-4935-bdd9-367f3dbdf4e0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.538055 Jun 17 08:54:08.288704 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 133/275] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:07 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:08.294873 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-6bf8e6a1-a0ac-4da7-8afa-5170926ee19e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:08.295924 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-6bf8e6a1-a0ac-4da7-8afa-5170926ee19e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:08.306442 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6bf8e6a1-a0ac-4da7-8afa-5170926ee19e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:08.307090 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6bf8e6a1-a0ac-4da7-8afa-5170926ee19e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:08.308377 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6bf8e6a1-a0ac-4da7-8afa-5170926ee19e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:08.309322 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6bf8e6a1-a0ac-4da7-8afa-5170926ee19e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:08.329293 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-7033623e-8259-48d4-8e39-b4046e81722c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:08.339206 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-7033623e-8259-48d4-8e39-b4046e81722c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:08.340991 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-7033623e-8259-48d4-8e39-b4046e81722c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:08.342177 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-7033623e-8259-48d4-8e39-b4046e81722c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1740 microversion: 2.20 time: 0.439686 Jun 17 08:54:08.342738 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 143/276] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:07 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1740 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:54:08.384396 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-6bf8e6a1-a0ac-4da7-8afa-5170926ee19e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:08.391815 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-6bf8e6a1-a0ac-4da7-8afa-5170926ee19e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1300 microversion: 2.1 time: 0.101299 Jun 17 08:54:08.392418 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 134/277] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:08 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1300 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:08.454461 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-c3501864-9a81-4dd3-9c4d-7f9f4439af56 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:08.455148 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-c3501864-9a81-4dd3-9c4d-7f9f4439af56 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:08.461349 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c3501864-9a81-4dd3-9c4d-7f9f4439af56 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:08.461799 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c3501864-9a81-4dd3-9c4d-7f9f4439af56 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:08.462562 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c3501864-9a81-4dd3-9c4d-7f9f4439af56 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:08.462994 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c3501864-9a81-4dd3-9c4d-7f9f4439af56 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:08.526938 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c3501864-9a81-4dd3-9c4d-7f9f4439af56 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:08.534762 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-c3501864-9a81-4dd3-9c4d-7f9f4439af56 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1263 microversion: 2.1 time: 0.084484 Jun 17 08:54:08.535421 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 144/278] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:08 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1263 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:08.556722 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-bbfb707d-73b9-4b1c-a2d9-bef23f9a0319 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:08.557383 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-bbfb707d-73b9-4b1c-a2d9-bef23f9a0319 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:08.565651 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bbfb707d-73b9-4b1c-a2d9-bef23f9a0319 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:08.566125 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bbfb707d-73b9-4b1c-a2d9-bef23f9a0319 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:08.566934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bbfb707d-73b9-4b1c-a2d9-bef23f9a0319 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:08.567398 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bbfb707d-73b9-4b1c-a2d9-bef23f9a0319 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:08.604177 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-0bd7849c-1044-4ced-ab76-8f526b4f14d9 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:08.605044 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-0bd7849c-1044-4ced-ab76-8f526b4f14d9 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:08.615878 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0bd7849c-1044-4ced-ab76-8f526b4f14d9 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:08.616625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0bd7849c-1044-4ced-ab76-8f526b4f14d9 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:08.618018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0bd7849c-1044-4ced-ab76-8f526b4f14d9 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:08.618458 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0bd7849c-1044-4ced-ab76-8f526b4f14d9 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:08.699458 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-0bd7849c-1044-4ced-ab76-8f526b4f14d9 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:08.707708 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-0bd7849c-1044-4ced-ab76-8f526b4f14d9 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1139 microversion: 2.1 time: 0.109036 Jun 17 08:54:08.708300 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 145/279] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:08 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1139 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:08.768109 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-bbfb707d-73b9-4b1c-a2d9-bef23f9a0319 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:08.776658 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-bbfb707d-73b9-4b1c-a2d9-bef23f9a0319 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1315 microversion: 2.1 time: 0.224593 Jun 17 08:54:08.777248 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 135/280] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:08 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:09.315731 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-577db34c-d47a-4b23-94fe-57342f0ae352 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:09.318941 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-577db34c-d47a-4b23-94fe-57342f0ae352 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:09.366833 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-b0d14a8f-b035-48d5-afcb-c8d9a36c7cfb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:09.368221 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-b0d14a8f-b035-48d5-afcb-c8d9a36c7cfb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:09.388817 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-577db34c-d47a-4b23-94fe-57342f0ae352 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:09.389636 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-577db34c-d47a-4b23-94fe-57342f0ae352 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:09.390633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-577db34c-d47a-4b23-94fe-57342f0ae352 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:09.391065 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-577db34c-d47a-4b23-94fe-57342f0ae352 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:09.411626 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b0d14a8f-b035-48d5-afcb-c8d9a36c7cfb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:09.416373 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b0d14a8f-b035-48d5-afcb-c8d9a36c7cfb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:09.418341 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b0d14a8f-b035-48d5-afcb-c8d9a36c7cfb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:09.421008 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b0d14a8f-b035-48d5-afcb-c8d9a36c7cfb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:09.863636 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b0d14a8f-b035-48d5-afcb-c8d9a36c7cfb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:09.888643 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b0d14a8f-b035-48d5-afcb-c8d9a36c7cfb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:09.890520 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b0d14a8f-b035-48d5-afcb-c8d9a36c7cfb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:09.892002 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-b0d14a8f-b035-48d5-afcb-c8d9a36c7cfb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1740 microversion: 2.20 time: 0.532695 Jun 17 08:54:09.908368 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 136/281] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:09 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1740 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:09.914508 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3c5317ae-e0f1-4fe1-bf0a-5b15f108c129 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:09.927917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-3c5317ae-e0f1-4fe1-bf0a-5b15f108c129 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:09.930727 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:09.944468 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3c5317ae-e0f1-4fe1-bf0a-5b15f108c129 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:09.945372 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3c5317ae-e0f1-4fe1-bf0a-5b15f108c129 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:09.946904 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3c5317ae-e0f1-4fe1-bf0a-5b15f108c129 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:09.947822 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3c5317ae-e0f1-4fe1-bf0a-5b15f108c129 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:10.025617 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-577db34c-d47a-4b23-94fe-57342f0ae352 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:10.058883 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-577db34c-d47a-4b23-94fe-57342f0ae352 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.753397 Jun 17 08:54:10.060211 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 146/282] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:09 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:10.077641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-51c650f3-b7b5-4ba4-968e-55fc8272eb2c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:10.078755 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-51c650f3-b7b5-4ba4-968e-55fc8272eb2c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:10.093887 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-51c650f3-b7b5-4ba4-968e-55fc8272eb2c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:10.097673 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-51c650f3-b7b5-4ba4-968e-55fc8272eb2c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:10.097673 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-51c650f3-b7b5-4ba4-968e-55fc8272eb2c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:10.097673 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-51c650f3-b7b5-4ba4-968e-55fc8272eb2c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:10.233721 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3c5317ae-e0f1-4fe1-bf0a-5b15f108c129 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:10.243029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-3c5317ae-e0f1-4fe1-bf0a-5b15f108c129 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1300 microversion: 2.1 time: 0.332295 Jun 17 08:54:10.244021 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 137/283] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:09 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1300 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:10.249937 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-ca5f2ddc-db63-47c7-ab36-c989e2e51fa1 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:10.250262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-ca5f2ddc-db63-47c7-ab36-c989e2e51fa1 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:10.260354 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ca5f2ddc-db63-47c7-ab36-c989e2e51fa1 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:10.260849 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-51c650f3-b7b5-4ba4-968e-55fc8272eb2c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:10.261199 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ca5f2ddc-db63-47c7-ab36-c989e2e51fa1 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:10.264358 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ca5f2ddc-db63-47c7-ab36-c989e2e51fa1 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:10.264358 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ca5f2ddc-db63-47c7-ab36-c989e2e51fa1 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:10.276285 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-51c650f3-b7b5-4ba4-968e-55fc8272eb2c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1311 microversion: 2.1 time: 0.214585 Jun 17 08:54:10.281765 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 147/284] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:10 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1311 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:10.281765 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e03134b5-2a1b-482d-a976-92f6fbfdd796 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:10.282115 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-e03134b5-2a1b-482d-a976-92f6fbfdd796 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:10.294848 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e03134b5-2a1b-482d-a976-92f6fbfdd796 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:10.297013 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e03134b5-2a1b-482d-a976-92f6fbfdd796 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:10.297887 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e03134b5-2a1b-482d-a976-92f6fbfdd796 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:10.298337 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e03134b5-2a1b-482d-a976-92f6fbfdd796 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:10.354900 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-ca5f2ddc-db63-47c7-ab36-c989e2e51fa1 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:10.364111 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-ca5f2ddc-db63-47c7-ab36-c989e2e51fa1 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1187 microversion: 2.1 time: 0.118954 Jun 17 08:54:10.380302 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 138/285] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:10 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1187 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:10.616024 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e03134b5-2a1b-482d-a976-92f6fbfdd796 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:10.634124 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-e03134b5-2a1b-482d-a976-92f6fbfdd796 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1315 microversion: 2.1 time: 0.351858 Jun 17 08:54:10.635294 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 148/286] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:10 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:10.910902 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3a8a5341-3656-4389-ba4e-b54669466b17 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:10.915887 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-3a8a5341-3656-4389-ba4e-b54669466b17 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:10.918941 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3a8a5341-3656-4389-ba4e-b54669466b17 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:10.919431 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3a8a5341-3656-4389-ba4e-b54669466b17 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:10.920360 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3a8a5341-3656-4389-ba4e-b54669466b17 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:10.920806 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3a8a5341-3656-4389-ba4e-b54669466b17 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:11.087861 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e957c8f2-e79d-4728-ad5d-0617fde3c563 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:11.099125 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-e957c8f2-e79d-4728-ad5d-0617fde3c563 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:11.102108 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:11.104218 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3a8a5341-3656-4389-ba4e-b54669466b17 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:11.113891 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e957c8f2-e79d-4728-ad5d-0617fde3c563 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:11.114630 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3a8a5341-3656-4389-ba4e-b54669466b17 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:11.116131 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e957c8f2-e79d-4728-ad5d-0617fde3c563 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:11.117626 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3a8a5341-3656-4389-ba4e-b54669466b17 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:11.118528 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e957c8f2-e79d-4728-ad5d-0617fde3c563 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:11.119368 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-3a8a5341-3656-4389-ba4e-b54669466b17 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1740 microversion: 2.20 time: 0.212379 Jun 17 08:54:11.119992 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e957c8f2-e79d-4728-ad5d-0617fde3c563 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:11.131064 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 139/287] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:10 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:11.262182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-2c5c8698-6b36-4c1a-9009-74a10e868645 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:11.263387 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-2c5c8698-6b36-4c1a-9009-74a10e868645 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:11.274860 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2c5c8698-6b36-4c1a-9009-74a10e868645 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:11.275229 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2c5c8698-6b36-4c1a-9009-74a10e868645 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:11.276308 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2c5c8698-6b36-4c1a-9009-74a10e868645 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:11.276839 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2c5c8698-6b36-4c1a-9009-74a10e868645 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:11.297023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e957c8f2-e79d-4728-ad5d-0617fde3c563 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:11.310699 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-e957c8f2-e79d-4728-ad5d-0617fde3c563 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.235230 Jun 17 08:54:11.311332 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 149/288] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:11 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:11.316987 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-aa2a9f45-e6af-4748-a04b-dce5f4b3275f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:11.317846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-aa2a9f45-e6af-4748-a04b-dce5f4b3275f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:11.325058 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-aa2a9f45-e6af-4748-a04b-dce5f4b3275f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:11.325766 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-aa2a9f45-e6af-4748-a04b-dce5f4b3275f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:11.326858 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-aa2a9f45-e6af-4748-a04b-dce5f4b3275f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:11.327490 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-aa2a9f45-e6af-4748-a04b-dce5f4b3275f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:11.416371 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-aa2a9f45-e6af-4748-a04b-dce5f4b3275f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:11.430476 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-aa2a9f45-e6af-4748-a04b-dce5f4b3275f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1311 microversion: 2.1 time: 0.117764 Jun 17 08:54:11.431745 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 150/289] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:11 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1311 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:11.450083 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e91e0d92-4b8a-4e61-b55a-8acf7892422f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:11.450729 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-e91e0d92-4b8a-4e61-b55a-8acf7892422f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:11.459817 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e91e0d92-4b8a-4e61-b55a-8acf7892422f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:11.460556 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e91e0d92-4b8a-4e61-b55a-8acf7892422f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:11.462557 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e91e0d92-4b8a-4e61-b55a-8acf7892422f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:11.464063 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e91e0d92-4b8a-4e61-b55a-8acf7892422f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:11.499097 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=100 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:11.510696 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2c5c8698-6b36-4c1a-9009-74a10e868645 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:11.523042 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-2c5c8698-6b36-4c1a-9009-74a10e868645 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.265626 Jun 17 08:54:11.534398 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 140/290] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:11 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:11.568736 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e91e0d92-4b8a-4e61-b55a-8acf7892422f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:11.581695 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-e91e0d92-4b8a-4e61-b55a-8acf7892422f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1187 microversion: 2.1 time: 0.148743 Jun 17 08:54:11.582296 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 151/291] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:11 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1187 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:11.660306 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-9254a124-bf47-43a9-bd39-574e109a20f2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:11.661653 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-9254a124-bf47-43a9-bd39-574e109a20f2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:11.670572 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9254a124-bf47-43a9-bd39-574e109a20f2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:11.676692 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9254a124-bf47-43a9-bd39-574e109a20f2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:11.678013 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9254a124-bf47-43a9-bd39-574e109a20f2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:11.678626 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9254a124-bf47-43a9-bd39-574e109a20f2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:11.863278 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-9254a124-bf47-43a9-bd39-574e109a20f2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:11.876686 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-9254a124-bf47-43a9-bd39-574e109a20f2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1315 microversion: 2.1 time: 0.223408 Jun 17 08:54:11.877711 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 141/292] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:11 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:12.142998 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e56e08ac-e94b-45b4-9b5b-88e167485248 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:12.142998 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-e56e08ac-e94b-45b4-9b5b-88e167485248 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:12.162409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e56e08ac-e94b-45b4-9b5b-88e167485248 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:12.162409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e56e08ac-e94b-45b4-9b5b-88e167485248 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:12.162409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e56e08ac-e94b-45b4-9b5b-88e167485248 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:12.162409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e56e08ac-e94b-45b4-9b5b-88e167485248 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:12.331835 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-df7aa1f0-ffec-4a9b-a629-40c1dd562d6f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:12.332396 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-df7aa1f0-ffec-4a9b-a629-40c1dd562d6f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:12.357110 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-df7aa1f0-ffec-4a9b-a629-40c1dd562d6f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:12.357356 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-df7aa1f0-ffec-4a9b-a629-40c1dd562d6f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:12.357937 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e56e08ac-e94b-45b4-9b5b-88e167485248 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:12.358903 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-df7aa1f0-ffec-4a9b-a629-40c1dd562d6f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:12.358903 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-df7aa1f0-ffec-4a9b-a629-40c1dd562d6f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:12.390789 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e56e08ac-e94b-45b4-9b5b-88e167485248 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:12.390789 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e56e08ac-e94b-45b4-9b5b-88e167485248 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:12.390789 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-e56e08ac-e94b-45b4-9b5b-88e167485248 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1740 microversion: 2.20 time: 0.237911 Jun 17 08:54:12.391102 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 152/293] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:12 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1740 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:12.391199 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=100 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:12.449263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-512a4886-6609-41ac-85e1-58769333b879 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:12.449950 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-512a4886-6609-41ac-85e1-58769333b879 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:12.456474 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-512a4886-6609-41ac-85e1-58769333b879 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:12.457006 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-512a4886-6609-41ac-85e1-58769333b879 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:12.459461 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-512a4886-6609-41ac-85e1-58769333b879 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:12.460169 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-512a4886-6609-41ac-85e1-58769333b879 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:12.523076 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-df7aa1f0-ffec-4a9b-a629-40c1dd562d6f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:12.533369 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-df7aa1f0-ffec-4a9b-a629-40c1dd562d6f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.207565 Jun 17 08:54:12.533954 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 142/294] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:12 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:12.543826 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-512a4886-6609-41ac-85e1-58769333b879 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:12.546420 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3c70fd2f-cfea-4c2e-952c-73d0db2ae7bd tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:12.547246 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-3c70fd2f-cfea-4c2e-952c-73d0db2ae7bd tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:12.551608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-512a4886-6609-41ac-85e1-58769333b879 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1311 microversion: 2.1 time: 0.106967 Jun 17 08:54:12.553612 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 153/295] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:12 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1311 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:12.556478 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3c70fd2f-cfea-4c2e-952c-73d0db2ae7bd tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:12.556952 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3c70fd2f-cfea-4c2e-952c-73d0db2ae7bd tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:12.557761 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3c70fd2f-cfea-4c2e-952c-73d0db2ae7bd tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:12.558195 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3c70fd2f-cfea-4c2e-952c-73d0db2ae7bd tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:12.599147 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-f4afe39f-6d06-4835-92d3-48ea248fe33f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:12.606678 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-f4afe39f-6d06-4835-92d3-48ea248fe33f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:12.606678 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f4afe39f-6d06-4835-92d3-48ea248fe33f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:12.607253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f4afe39f-6d06-4835-92d3-48ea248fe33f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:12.608155 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f4afe39f-6d06-4835-92d3-48ea248fe33f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:12.608680 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f4afe39f-6d06-4835-92d3-48ea248fe33f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:12.697739 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-f4afe39f-6d06-4835-92d3-48ea248fe33f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:12.711826 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-f4afe39f-6d06-4835-92d3-48ea248fe33f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1187 microversion: 2.1 time: 0.113644 Jun 17 08:54:12.711826 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 154/296] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:12 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1187 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:12.741516 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3c70fd2f-cfea-4c2e-952c-73d0db2ae7bd tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:12.750488 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-3c70fd2f-cfea-4c2e-952c-73d0db2ae7bd tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.207896 Jun 17 08:54:12.751167 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 143/297] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:12 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:12.894293 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-7d8f47b9-151b-4cab-a4b3-79dff81a14de tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:12.894981 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-7d8f47b9-151b-4cab-a4b3-79dff81a14de tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:12.902840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7d8f47b9-151b-4cab-a4b3-79dff81a14de tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:12.903853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7d8f47b9-151b-4cab-a4b3-79dff81a14de tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:12.904739 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7d8f47b9-151b-4cab-a4b3-79dff81a14de tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:12.905179 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7d8f47b9-151b-4cab-a4b3-79dff81a14de tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:13.120121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-7d8f47b9-151b-4cab-a4b3-79dff81a14de tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:13.128396 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-7d8f47b9-151b-4cab-a4b3-79dff81a14de tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1315 microversion: 2.1 time: 0.238185 Jun 17 08:54:13.129272 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 155/298] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:12 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:13.392920 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d6bef4cc-16ec-47ad-ad17-b94fc71361d8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:13.393948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-d6bef4cc-16ec-47ad-ad17-b94fc71361d8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:13.409127 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d6bef4cc-16ec-47ad-ad17-b94fc71361d8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:13.409734 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d6bef4cc-16ec-47ad-ad17-b94fc71361d8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:13.410752 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d6bef4cc-16ec-47ad-ad17-b94fc71361d8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:13.411304 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d6bef4cc-16ec-47ad-ad17-b94fc71361d8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:13.554005 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-bad8c9c6-9e61-4643-ab22-d34409a75cd6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:13.556463 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-bad8c9c6-9e61-4643-ab22-d34409a75cd6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:13.568121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bad8c9c6-9e61-4643-ab22-d34409a75cd6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:13.568966 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bad8c9c6-9e61-4643-ab22-d34409a75cd6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:13.570041 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bad8c9c6-9e61-4643-ab22-d34409a75cd6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:13.571469 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bad8c9c6-9e61-4643-ab22-d34409a75cd6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:13.680866 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=6 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:13.897017 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=2 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:13.897340 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d6bef4cc-16ec-47ad-ad17-b94fc71361d8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:13.912264 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d6bef4cc-16ec-47ad-ad17-b94fc71361d8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:13.916526 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d6bef4cc-16ec-47ad-ad17-b94fc71361d8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:13.918340 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-d6bef4cc-16ec-47ad-ad17-b94fc71361d8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1740 microversion: 2.20 time: 0.529790 Jun 17 08:54:13.919974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 144/299] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:13 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1740 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:13.927839 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-16e5861f-c86e-47c8-985f-bded8b8300cc tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:13.928031 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=16 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:13.934217 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-16e5861f-c86e-47c8-985f-bded8b8300cc tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:13.938606 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-16e5861f-c86e-47c8-985f-bded8b8300cc tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:13.939422 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-16e5861f-c86e-47c8-985f-bded8b8300cc tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:13.940531 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-16e5861f-c86e-47c8-985f-bded8b8300cc tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:13.941165 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-16e5861f-c86e-47c8-985f-bded8b8300cc tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:14.043029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-16e5861f-c86e-47c8-985f-bded8b8300cc tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:14.054845 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-16e5861f-c86e-47c8-985f-bded8b8300cc tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1311 microversion: 2.1 time: 0.133380 Jun 17 08:54:14.063926 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-bad8c9c6-9e61-4643-ab22-d34409a75cd6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:14.065666 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 145/300] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:13 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1311 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:14.072258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-64f67d4c-bdf8-4df8-82df-fb2e127d5a8f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:14.072458 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-bad8c9c6-9e61-4643-ab22-d34409a75cd6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.526149 Jun 17 08:54:14.073252 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-64f67d4c-bdf8-4df8-82df-fb2e127d5a8f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:14.075143 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 156/301] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:13 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:14.081181 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-64f67d4c-bdf8-4df8-82df-fb2e127d5a8f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:14.081915 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-64f67d4c-bdf8-4df8-82df-fb2e127d5a8f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:14.082557 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-df0863e9-75f7-4daf-8bb8-b24c01610912 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:14.083172 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-df0863e9-75f7-4daf-8bb8-b24c01610912 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:14.083411 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-64f67d4c-bdf8-4df8-82df-fb2e127d5a8f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:14.084054 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-64f67d4c-bdf8-4df8-82df-fb2e127d5a8f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:14.089853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-df0863e9-75f7-4daf-8bb8-b24c01610912 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:14.090304 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-df0863e9-75f7-4daf-8bb8-b24c01610912 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:14.091246 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-df0863e9-75f7-4daf-8bb8-b24c01610912 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:14.091790 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-df0863e9-75f7-4daf-8bb8-b24c01610912 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:14.256684 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-64f67d4c-bdf8-4df8-82df-fb2e127d5a8f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:14.275253 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-64f67d4c-bdf8-4df8-82df-fb2e127d5a8f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1187 microversion: 2.1 time: 0.206504 Jun 17 08:54:14.284880 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 146/302] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:14 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1187 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:14.284880 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-16652e86-c5be-4ec2-a4a0-941feb9fd2fc tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:14.284880 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-16652e86-c5be-4ec2-a4a0-941feb9fd2fc tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:14.298321 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-16652e86-c5be-4ec2-a4a0-941feb9fd2fc tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:14.298794 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-16652e86-c5be-4ec2-a4a0-941feb9fd2fc tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:14.299753 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-16652e86-c5be-4ec2-a4a0-941feb9fd2fc tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:14.300210 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-16652e86-c5be-4ec2-a4a0-941feb9fd2fc tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:14.444483 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-df0863e9-75f7-4daf-8bb8-b24c01610912 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:14.463718 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-df0863e9-75f7-4daf-8bb8-b24c01610912 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.374358 Jun 17 08:54:14.464975 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 157/303] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:14 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:14.624928 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-16652e86-c5be-4ec2-a4a0-941feb9fd2fc tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:14.631090 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-16652e86-c5be-4ec2-a4a0-941feb9fd2fc tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1315 microversion: 2.1 time: 0.352011 Jun 17 08:54:14.641447 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 147/304] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:14 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:14.943850 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a29eeb10-9f33-46f6-912b-283a17689469 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:14.943850 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a29eeb10-9f33-46f6-912b-283a17689469 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:14.952896 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a29eeb10-9f33-46f6-912b-283a17689469 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:14.966719 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a29eeb10-9f33-46f6-912b-283a17689469 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:14.967905 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a29eeb10-9f33-46f6-912b-283a17689469 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:14.968358 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a29eeb10-9f33-46f6-912b-283a17689469 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:15.073104 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-82b24ef1-6fd6-42ba-99eb-866af3b9bef0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:15.073715 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-82b24ef1-6fd6-42ba-99eb-866af3b9bef0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:15.082821 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=28 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:15.087340 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-82b24ef1-6fd6-42ba-99eb-866af3b9bef0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:15.087340 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-82b24ef1-6fd6-42ba-99eb-866af3b9bef0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:15.088176 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-82b24ef1-6fd6-42ba-99eb-866af3b9bef0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:15.088616 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-82b24ef1-6fd6-42ba-99eb-866af3b9bef0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:15.271330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-82b24ef1-6fd6-42ba-99eb-866af3b9bef0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:15.283488 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-82b24ef1-6fd6-42ba-99eb-866af3b9bef0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1317 microversion: 2.1 time: 0.213922 Jun 17 08:54:15.295319 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 148/305] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:15 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:15.300501 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a29eeb10-9f33-46f6-912b-283a17689469 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:15.300697 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-6b8ed265-e568-4140-a0d7-fe22705b4b9b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:15.301361 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-6b8ed265-e568-4140-a0d7-fe22705b4b9b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:15.308163 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6b8ed265-e568-4140-a0d7-fe22705b4b9b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:15.308608 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6b8ed265-e568-4140-a0d7-fe22705b4b9b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:15.309923 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6b8ed265-e568-4140-a0d7-fe22705b4b9b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:15.310367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6b8ed265-e568-4140-a0d7-fe22705b4b9b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:15.319526 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a29eeb10-9f33-46f6-912b-283a17689469 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:15.324055 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a29eeb10-9f33-46f6-912b-283a17689469 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:15.329213 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a29eeb10-9f33-46f6-912b-283a17689469 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1740 microversion: 2.20 time: 0.390199 Jun 17 08:54:15.329688 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 158/306] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:14 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1740 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:15.367524 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-31839383-297e-4c32-b3ed-467c9db9e587 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:15.381293 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-31839383-297e-4c32-b3ed-467c9db9e587 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:15.393201 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-31839383-297e-4c32-b3ed-467c9db9e587 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:15.394276 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-31839383-297e-4c32-b3ed-467c9db9e587 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:15.395102 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-31839383-297e-4c32-b3ed-467c9db9e587 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:15.395605 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-31839383-297e-4c32-b3ed-467c9db9e587 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:15.607291 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-31839383-297e-4c32-b3ed-467c9db9e587 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:15.622065 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-31839383-297e-4c32-b3ed-467c9db9e587 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1205 microversion: 2.1 time: 0.291131 Jun 17 08:54:15.623696 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 159/307] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:15 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1205 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:15.635042 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-de65f065-b34b-4903-b399-9aaaa57a114a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:15.647520 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-de65f065-b34b-4903-b399-9aaaa57a114a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:15.655800 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-de65f065-b34b-4903-b399-9aaaa57a114a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:15.656686 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-de65f065-b34b-4903-b399-9aaaa57a114a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:15.657923 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-de65f065-b34b-4903-b399-9aaaa57a114a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:15.658820 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-de65f065-b34b-4903-b399-9aaaa57a114a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:15.855582 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-6b8ed265-e568-4140-a0d7-fe22705b4b9b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:15.870555 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-6b8ed265-e568-4140-a0d7-fe22705b4b9b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.573988 Jun 17 08:54:15.876413 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 149/308] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:15 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:15.884058 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3121fac7-249b-4611-ae1a-d28c2c86d6d7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:15.884844 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-3121fac7-249b-4611-ae1a-d28c2c86d6d7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:15.892109 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3121fac7-249b-4611-ae1a-d28c2c86d6d7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:15.898283 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3121fac7-249b-4611-ae1a-d28c2c86d6d7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:15.900024 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3121fac7-249b-4611-ae1a-d28c2c86d6d7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:15.900649 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3121fac7-249b-4611-ae1a-d28c2c86d6d7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:16.163238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-de65f065-b34b-4903-b399-9aaaa57a114a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:16.190160 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-de65f065-b34b-4903-b399-9aaaa57a114a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.564263 Jun 17 08:54:16.191583 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 160/309] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:15 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:16.202091 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-30c34936-8bcf-45bb-806c-e85d26aa07a9 req-34b525bf-c4b5-4e96-abd4-50d257a3dae1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d", "tag": "865d7ab5-9d19-42eb-8363-e2eb81b9295c"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:54:16.211839 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3121fac7-249b-4611-ae1a-d28c2c86d6d7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:16.220030 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-30c34936-8bcf-45bb-806c-e85d26aa07a9 req-34b525bf-c4b5-4e96-abd4-50d257a3dae1 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:16.223145 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-3121fac7-249b-4611-ae1a-d28c2c86d6d7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1315 microversion: 2.1 time: 0.345137 Jun 17 08:54:16.223779 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-30c34936-8bcf-45bb-806c-e85d26aa07a9 req-34b525bf-c4b5-4e96-abd4-50d257a3dae1 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:16.224289 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 150/310] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:15 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:16.238934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-30c34936-8bcf-45bb-806c-e85d26aa07a9 req-34b525bf-c4b5-4e96-abd4-50d257a3dae1 service nova] Creating event network-changed:865d7ab5-9d19-42eb-8363-e2eb81b9295c for instance 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d on hv-cinder-79760 Jun 17 08:54:16.247562 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-30c34936-8bcf-45bb-806c-e85d26aa07a9 req-34b525bf-c4b5-4e96-abd4-50d257a3dae1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053454 Jun 17 08:54:16.248420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 161/311] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:54:16.248655 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-bc6b5b51-e4e5-4b9a-a7df-d232fdb7b8e3 req-22273f38-aa06-48ce-b269-8430d135b5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c5d606-fea9-467c-a074-2a9a1030a461", "name": "network-vif-plugged", "status": "completed", "tag": "becbd5f3-c900-4dec-a28c-cf23062ef2fb"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:54:16.259936 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-bc6b5b51-e4e5-4b9a-a7df-d232fdb7b8e3 req-22273f38-aa06-48ce-b269-8430d135b5f0 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:16.263623 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-bc6b5b51-e4e5-4b9a-a7df-d232fdb7b8e3 req-22273f38-aa06-48ce-b269-8430d135b5f0 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:16.273398 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-bc6b5b51-e4e5-4b9a-a7df-d232fdb7b8e3 req-22273f38-aa06-48ce-b269-8430d135b5f0 service nova] Creating event network-vif-plugged:becbd5f3-c900-4dec-a28c-cf23062ef2fb for instance 30c5d606-fea9-467c-a074-2a9a1030a461 on hv-cinder-79760 Jun 17 08:54:16.279180 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-bc6b5b51-e4e5-4b9a-a7df-d232fdb7b8e3 req-22273f38-aa06-48ce-b269-8430d135b5f0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037594 Jun 17 08:54:16.280628 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 151/312] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:54:16.319970 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-c426529d-9baf-4eb5-9f3a-36d234b168d8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:16.322185 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-c426529d-9baf-4eb5-9f3a-36d234b168d8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:16.337725 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c426529d-9baf-4eb5-9f3a-36d234b168d8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:16.338456 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c426529d-9baf-4eb5-9f3a-36d234b168d8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:16.339493 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c426529d-9baf-4eb5-9f3a-36d234b168d8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:16.340753 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c426529d-9baf-4eb5-9f3a-36d234b168d8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:16.348751 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-e94ce586-3d84-4e43-8b69-030c177cdc66 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:16.357466 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-e94ce586-3d84-4e43-8b69-030c177cdc66 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:16.364818 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e94ce586-3d84-4e43-8b69-030c177cdc66 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:16.365605 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e94ce586-3d84-4e43-8b69-030c177cdc66 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:16.366604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e94ce586-3d84-4e43-8b69-030c177cdc66 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:16.367991 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e94ce586-3d84-4e43-8b69-030c177cdc66 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:16.455165 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c426529d-9baf-4eb5-9f3a-36d234b168d8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:16.470129 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-c426529d-9baf-4eb5-9f3a-36d234b168d8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1317 microversion: 2.1 time: 0.155375 Jun 17 08:54:16.470129 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 162/313] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:16 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:16.588743 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-e94ce586-3d84-4e43-8b69-030c177cdc66 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:16.607150 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-e94ce586-3d84-4e43-8b69-030c177cdc66 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:16.608917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-e94ce586-3d84-4e43-8b69-030c177cdc66 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:16.611839 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-e94ce586-3d84-4e43-8b69-030c177cdc66 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1740 microversion: 2.20 time: 0.267262 Jun 17 08:54:16.619214 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 152/314] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:16 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1740 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:54:16.639944 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-bf9ebbe7-55b4-479a-8c73-1ebf6abda9d3 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:16.640934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-bf9ebbe7-55b4-479a-8c73-1ebf6abda9d3 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:16.647623 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bf9ebbe7-55b4-479a-8c73-1ebf6abda9d3 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:16.648547 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bf9ebbe7-55b4-479a-8c73-1ebf6abda9d3 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:16.649606 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bf9ebbe7-55b4-479a-8c73-1ebf6abda9d3 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:16.650369 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bf9ebbe7-55b4-479a-8c73-1ebf6abda9d3 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:16.912360 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-90eeda78-5cf4-4836-860a-3c68dc4878a1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:16.917600 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-90eeda78-5cf4-4836-860a-3c68dc4878a1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:16.920761 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-bf9ebbe7-55b4-479a-8c73-1ebf6abda9d3 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:16.932898 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-bf9ebbe7-55b4-479a-8c73-1ebf6abda9d3 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1272 microversion: 2.1 time: 0.296724 Jun 17 08:54:16.934602 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 163/315] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:16 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1272 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:16.945942 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-90eeda78-5cf4-4836-860a-3c68dc4878a1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:16.950735 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-90eeda78-5cf4-4836-860a-3c68dc4878a1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:16.954778 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-90eeda78-5cf4-4836-860a-3c68dc4878a1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:16.955489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-90eeda78-5cf4-4836-860a-3c68dc4878a1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:17.145742 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-90eeda78-5cf4-4836-860a-3c68dc4878a1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:17.155496 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-90eeda78-5cf4-4836-860a-3c68dc4878a1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.260033 Jun 17 08:54:17.157561 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 153/316] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:16 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:17.210199 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-fbd4fcae-c660-4163-abe9-56015f60d055 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:17.212742 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-fbd4fcae-c660-4163-abe9-56015f60d055 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:17.224457 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fbd4fcae-c660-4163-abe9-56015f60d055 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:17.225019 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fbd4fcae-c660-4163-abe9-56015f60d055 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:17.225933 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fbd4fcae-c660-4163-abe9-56015f60d055 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:17.226664 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fbd4fcae-c660-4163-abe9-56015f60d055 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:17.242257 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-8b2fb6a6-9d6b-4897-a4aa-fd56c73b5cfe tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:17.243795 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-8b2fb6a6-9d6b-4897-a4aa-fd56c73b5cfe tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:17.254879 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8b2fb6a6-9d6b-4897-a4aa-fd56c73b5cfe tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:17.258633 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8b2fb6a6-9d6b-4897-a4aa-fd56c73b5cfe tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:17.259672 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8b2fb6a6-9d6b-4897-a4aa-fd56c73b5cfe tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:17.260132 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8b2fb6a6-9d6b-4897-a4aa-fd56c73b5cfe tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:17.505713 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-fbd4fcae-c660-4163-abe9-56015f60d055 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:17.510168 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-8b2fb6a6-9d6b-4897-a4aa-fd56c73b5cfe tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:17.514665 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-fbd4fcae-c660-4163-abe9-56015f60d055 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.309728 Jun 17 08:54:17.520989 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 164/317] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:17 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:17.521401 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e3a8eac1-aaad-4bbd-866c-f9b9d1350f25 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:17.521599 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-8b2fb6a6-9d6b-4897-a4aa-fd56c73b5cfe tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1315 microversion: 2.1 time: 0.283302 Jun 17 08:54:17.522339 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-e3a8eac1-aaad-4bbd-866c-f9b9d1350f25 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:17.532831 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 154/318] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:17 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:17.541968 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e3a8eac1-aaad-4bbd-866c-f9b9d1350f25 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:17.542498 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e3a8eac1-aaad-4bbd-866c-f9b9d1350f25 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:17.543373 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e3a8eac1-aaad-4bbd-866c-f9b9d1350f25 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:17.543910 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e3a8eac1-aaad-4bbd-866c-f9b9d1350f25 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:17.641352 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-9702d2bc-42a2-4de1-bf60-3f170d0d27f8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:17.641964 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-9702d2bc-42a2-4de1-bf60-3f170d0d27f8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:17.653514 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9702d2bc-42a2-4de1-bf60-3f170d0d27f8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:17.654015 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9702d2bc-42a2-4de1-bf60-3f170d0d27f8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:17.655488 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9702d2bc-42a2-4de1-bf60-3f170d0d27f8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:17.655488 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9702d2bc-42a2-4de1-bf60-3f170d0d27f8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:17.715450 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e3a8eac1-aaad-4bbd-866c-f9b9d1350f25 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:17.730062 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-e3a8eac1-aaad-4bbd-866c-f9b9d1350f25 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1359 microversion: 2.1 time: 0.213104 Jun 17 08:54:17.730868 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 165/319] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:17 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:17.814887 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-9702d2bc-42a2-4de1-bf60-3f170d0d27f8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:17.823027 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-9702d2bc-42a2-4de1-bf60-3f170d0d27f8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:17.824573 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-9702d2bc-42a2-4de1-bf60-3f170d0d27f8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:17.825744 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-9702d2bc-42a2-4de1-bf60-3f170d0d27f8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1740 microversion: 2.20 time: 0.189049 Jun 17 08:54:17.826566 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 155/320] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:17 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:54:17.951038 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e876db5e-896f-45a0-b2cb-cb8eba8288c4 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:17.951596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-e876db5e-896f-45a0-b2cb-cb8eba8288c4 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:17.957845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e876db5e-896f-45a0-b2cb-cb8eba8288c4 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:17.958292 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e876db5e-896f-45a0-b2cb-cb8eba8288c4 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:17.959046 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e876db5e-896f-45a0-b2cb-cb8eba8288c4 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:17.959506 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e876db5e-896f-45a0-b2cb-cb8eba8288c4 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:18.131103 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e876db5e-896f-45a0-b2cb-cb8eba8288c4 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:18.143735 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-e876db5e-896f-45a0-b2cb-cb8eba8288c4 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1272 microversion: 2.1 time: 0.196523 Jun 17 08:54:18.144324 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 166/321] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:17 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1272 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:18.175912 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-eb749fec-dc65-4dfa-99ea-93e7c1804fca tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:18.176863 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-eb749fec-dc65-4dfa-99ea-93e7c1804fca tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:18.183122 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eb749fec-dc65-4dfa-99ea-93e7c1804fca tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:18.183706 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eb749fec-dc65-4dfa-99ea-93e7c1804fca tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:18.184834 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eb749fec-dc65-4dfa-99ea-93e7c1804fca tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:18.185277 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eb749fec-dc65-4dfa-99ea-93e7c1804fca tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:18.330034 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-eb749fec-dc65-4dfa-99ea-93e7c1804fca tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:18.341898 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-eb749fec-dc65-4dfa-99ea-93e7c1804fca tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.169842 Jun 17 08:54:18.343386 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 156/322] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:18 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:18.536384 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-f171900d-262f-4f49-8373-0bcf2fbdd43e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:18.536959 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-f171900d-262f-4f49-8373-0bcf2fbdd43e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:18.541735 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-df5fed4c-b12b-462d-9991-0685b88ad34d tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:18.542499 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-df5fed4c-b12b-462d-9991-0685b88ad34d tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:18.544333 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f171900d-262f-4f49-8373-0bcf2fbdd43e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:18.544964 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f171900d-262f-4f49-8373-0bcf2fbdd43e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:18.545898 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f171900d-262f-4f49-8373-0bcf2fbdd43e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:18.546573 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f171900d-262f-4f49-8373-0bcf2fbdd43e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:18.550016 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-df5fed4c-b12b-462d-9991-0685b88ad34d tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:18.550720 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-df5fed4c-b12b-462d-9991-0685b88ad34d tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:18.551615 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-df5fed4c-b12b-462d-9991-0685b88ad34d tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:18.552176 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-df5fed4c-b12b-462d-9991-0685b88ad34d tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:18.782862 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-df5fed4c-b12b-462d-9991-0685b88ad34d tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:18.784804 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-f171900d-262f-4f49-8373-0bcf2fbdd43e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:18.791673 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-df5fed4c-b12b-462d-9991-0685b88ad34d tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1315 microversion: 2.1 time: 0.255892 Jun 17 08:54:18.797436 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-f171900d-262f-4f49-8373-0bcf2fbdd43e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.265475 Jun 17 08:54:18.798289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 167/323] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:18 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:18.807659 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 157/324] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:18 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:18.807659 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-c41a1b83-9367-43bf-ade0-d8ff9dab4c08 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:18.807659 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-c41a1b83-9367-43bf-ade0-d8ff9dab4c08 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:18.814116 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c41a1b83-9367-43bf-ade0-d8ff9dab4c08 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:18.814579 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c41a1b83-9367-43bf-ade0-d8ff9dab4c08 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:18.815390 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c41a1b83-9367-43bf-ade0-d8ff9dab4c08 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:18.815835 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c41a1b83-9367-43bf-ade0-d8ff9dab4c08 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:18.849458 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-c4332515-2068-4259-84d9-ffffd99850c6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:18.850180 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-c4332515-2068-4259-84d9-ffffd99850c6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:18.856796 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c4332515-2068-4259-84d9-ffffd99850c6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:18.857367 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c4332515-2068-4259-84d9-ffffd99850c6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:18.858400 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c4332515-2068-4259-84d9-ffffd99850c6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:18.859461 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c4332515-2068-4259-84d9-ffffd99850c6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:19.037694 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c41a1b83-9367-43bf-ade0-d8ff9dab4c08 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:19.046084 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-c41a1b83-9367-43bf-ade0-d8ff9dab4c08 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1359 microversion: 2.1 time: 0.243775 Jun 17 08:54:19.046577 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 158/325] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:18 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1359 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:19.061565 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c4332515-2068-4259-84d9-ffffd99850c6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:19.064000 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=100 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:19.070581 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c4332515-2068-4259-84d9-ffffd99850c6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:19.072154 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c4332515-2068-4259-84d9-ffffd99850c6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:19.073618 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-c4332515-2068-4259-84d9-ffffd99850c6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1740 microversion: 2.20 time: 0.230305 Jun 17 08:54:19.077103 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 168/326] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:18 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1740 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:19.160983 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d6cf6094-8727-4bc9-8f62-2847278efe1b tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:19.161884 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-d6cf6094-8727-4bc9-8f62-2847278efe1b tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:19.168984 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d6cf6094-8727-4bc9-8f62-2847278efe1b tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:19.170478 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d6cf6094-8727-4bc9-8f62-2847278efe1b tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:19.170478 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d6cf6094-8727-4bc9-8f62-2847278efe1b tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:19.170822 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d6cf6094-8727-4bc9-8f62-2847278efe1b tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:19.361827 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a17e0492-e60c-4054-bf29-4ad1f942d66b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:19.362738 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a17e0492-e60c-4054-bf29-4ad1f942d66b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:19.378846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a17e0492-e60c-4054-bf29-4ad1f942d66b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:19.379672 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a17e0492-e60c-4054-bf29-4ad1f942d66b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:19.380812 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a17e0492-e60c-4054-bf29-4ad1f942d66b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:19.381571 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a17e0492-e60c-4054-bf29-4ad1f942d66b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:19.454287 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d6cf6094-8727-4bc9-8f62-2847278efe1b tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:19.457778 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=100 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:19.464369 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-d6cf6094-8727-4bc9-8f62-2847278efe1b tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1272 microversion: 2.1 time: 0.307278 Jun 17 08:54:19.465673 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 159/327] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:19 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1272 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:19.663059 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a17e0492-e60c-4054-bf29-4ad1f942d66b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:19.672137 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a17e0492-e60c-4054-bf29-4ad1f942d66b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.314152 Jun 17 08:54:19.673050 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 169/328] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:19 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:19.808663 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-ae5875c4-3899-4fa1-b4c5-d8bca353c5e3 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:19.809866 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-ae5875c4-3899-4fa1-b4c5-d8bca353c5e3 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:19.816314 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-d0673ffb-e76e-4850-a2e6-60e78bfa2020 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:19.817513 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ae5875c4-3899-4fa1-b4c5-d8bca353c5e3 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:19.817675 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-d0673ffb-e76e-4850-a2e6-60e78bfa2020 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:19.817963 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ae5875c4-3899-4fa1-b4c5-d8bca353c5e3 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:19.818877 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ae5875c4-3899-4fa1-b4c5-d8bca353c5e3 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:19.819315 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ae5875c4-3899-4fa1-b4c5-d8bca353c5e3 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:19.824628 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d0673ffb-e76e-4850-a2e6-60e78bfa2020 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:19.825157 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d0673ffb-e76e-4850-a2e6-60e78bfa2020 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:19.826001 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d0673ffb-e76e-4850-a2e6-60e78bfa2020 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:19.826506 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d0673ffb-e76e-4850-a2e6-60e78bfa2020 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:20.451470 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-ae5875c4-3899-4fa1-b4c5-d8bca353c5e3 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:20.455872 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-d0673ffb-e76e-4850-a2e6-60e78bfa2020 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:20.467905 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-ae5875c4-3899-4fa1-b4c5-d8bca353c5e3 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1315 microversion: 2.1 time: 0.663354 Jun 17 08:54:20.468465 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-d0673ffb-e76e-4850-a2e6-60e78bfa2020 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.655531 Jun 17 08:54:20.469199 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 170/329] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:19 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:20.482016 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-22583fc9-fd9d-42cf-8d5b-b6fab88d3294 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:20.483133 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-22583fc9-fd9d-42cf-8d5b-b6fab88d3294 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:20.488188 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 160/330] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:19 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1315 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:20.495696 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-f52668ce-a9d4-4368-b806-dd8216518d12 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:20.496315 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-f52668ce-a9d4-4368-b806-dd8216518d12 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:20.498891 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-22583fc9-fd9d-42cf-8d5b-b6fab88d3294 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:20.499797 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-22583fc9-fd9d-42cf-8d5b-b6fab88d3294 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:20.502468 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-22583fc9-fd9d-42cf-8d5b-b6fab88d3294 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:20.503157 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-22583fc9-fd9d-42cf-8d5b-b6fab88d3294 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:20.504309 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f52668ce-a9d4-4368-b806-dd8216518d12 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:20.504821 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f52668ce-a9d4-4368-b806-dd8216518d12 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:20.505975 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f52668ce-a9d4-4368-b806-dd8216518d12 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:20.506411 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f52668ce-a9d4-4368-b806-dd8216518d12 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:20.744325 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-22583fc9-fd9d-42cf-8d5b-b6fab88d3294 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:20.765196 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f52668ce-a9d4-4368-b806-dd8216518d12 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:20.777048 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f52668ce-a9d4-4368-b806-dd8216518d12 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:20.779950 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f52668ce-a9d4-4368-b806-dd8216518d12 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:20.781504 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-f52668ce-a9d4-4368-b806-dd8216518d12 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1740 microversion: 2.20 time: 0.292279 Jun 17 08:54:20.786944 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-22583fc9-fd9d-42cf-8d5b-b6fab88d3294 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1359 microversion: 2.1 time: 0.316276 Jun 17 08:54:20.794298 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 161/331] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:20 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:20.796429 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 171/332] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:20 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1359 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:20.810648 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-8402e913-d127-43a1-b8d4-e7c93025fe61 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:20.811546 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-8402e913-d127-43a1-b8d4-e7c93025fe61 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:20.820686 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8402e913-d127-43a1-b8d4-e7c93025fe61 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:20.821307 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-fda35e0d-2b84-4552-8fdb-366f89ee1912 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:20.822123 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-fda35e0d-2b84-4552-8fdb-366f89ee1912 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:20.822302 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8402e913-d127-43a1-b8d4-e7c93025fe61 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:20.823508 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8402e913-d127-43a1-b8d4-e7c93025fe61 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:20.824161 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8402e913-d127-43a1-b8d4-e7c93025fe61 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:20.846998 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fda35e0d-2b84-4552-8fdb-366f89ee1912 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:20.847551 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fda35e0d-2b84-4552-8fdb-366f89ee1912 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:20.848433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fda35e0d-2b84-4552-8fdb-366f89ee1912 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:20.848870 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fda35e0d-2b84-4552-8fdb-366f89ee1912 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:21.225854 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-fda35e0d-2b84-4552-8fdb-366f89ee1912 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:21.241530 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-8402e913-d127-43a1-b8d4-e7c93025fe61 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:21.250576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-8402e913-d127-43a1-b8d4-e7c93025fe61 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.454802 Jun 17 08:54:21.251167 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 162/333] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:20 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:21.260819 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-fda35e0d-2b84-4552-8fdb-366f89ee1912 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.450577 Jun 17 08:54:21.260819 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 172/334] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:20 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:21.268345 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-d4e552bf-b174-406c-98b8-c322d7361e82 req-c2dd1bb0-a25e-4239-bb13-efbad90f1fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e254b695-5369-48d6-9966-64f25873dc0d", "tag": "5a6e2dcc-1d88-4ebd-8cce-063737a7db08"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:54:21.277951 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-d4e552bf-b174-406c-98b8-c322d7361e82 req-c2dd1bb0-a25e-4239-bb13-efbad90f1fd4 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:21.278490 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-d4e552bf-b174-406c-98b8-c322d7361e82 req-c2dd1bb0-a25e-4239-bb13-efbad90f1fd4 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:21.291360 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-d4e552bf-b174-406c-98b8-c322d7361e82 req-c2dd1bb0-a25e-4239-bb13-efbad90f1fd4 service nova] Creating event network-changed:5a6e2dcc-1d88-4ebd-8cce-063737a7db08 for instance e254b695-5369-48d6-9966-64f25873dc0d on hv-cinder-79760 Jun 17 08:54:21.296886 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-d4e552bf-b174-406c-98b8-c322d7361e82 req-c2dd1bb0-a25e-4239-bb13-efbad90f1fd4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042619 Jun 17 08:54:21.297558 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 173/335] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:54:21.486375 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-21e2c72e-a636-4bbd-a211-0d973d8ca74f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:21.487636 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-21e2c72e-a636-4bbd-a211-0d973d8ca74f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:21.496557 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-21e2c72e-a636-4bbd-a211-0d973d8ca74f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:21.497247 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-21e2c72e-a636-4bbd-a211-0d973d8ca74f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:21.498276 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-21e2c72e-a636-4bbd-a211-0d973d8ca74f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:21.498927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-21e2c72e-a636-4bbd-a211-0d973d8ca74f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:21.501028 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-54d4b42b-f4f4-47c0-be4f-1baa6644a192 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:21.502063 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-54d4b42b-f4f4-47c0-be4f-1baa6644a192 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:21.512736 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-54d4b42b-f4f4-47c0-be4f-1baa6644a192 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:21.515000 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-54d4b42b-f4f4-47c0-be4f-1baa6644a192 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:21.515000 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-54d4b42b-f4f4-47c0-be4f-1baa6644a192 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:21.515000 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-54d4b42b-f4f4-47c0-be4f-1baa6644a192 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:21.740049 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-54d4b42b-f4f4-47c0-be4f-1baa6644a192 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:21.752087 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-21e2c72e-a636-4bbd-a211-0d973d8ca74f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:21.755637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-54d4b42b-f4f4-47c0-be4f-1baa6644a192 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1315 microversion: 2.1 time: 0.255317 Jun 17 08:54:21.761319 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 174/336] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:21 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:21.766606 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-21e2c72e-a636-4bbd-a211-0d973d8ca74f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.283531 Jun 17 08:54:21.772025 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 163/337] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:21 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:21.801328 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-8b88a62e-bb72-4383-8f8b-eb30d9b2c835 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:21.802228 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-8b88a62e-bb72-4383-8f8b-eb30d9b2c835 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:21.810368 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8b88a62e-bb72-4383-8f8b-eb30d9b2c835 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:21.810876 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8b88a62e-bb72-4383-8f8b-eb30d9b2c835 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:21.812035 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8b88a62e-bb72-4383-8f8b-eb30d9b2c835 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:21.812210 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-ee69e93b-0850-4bd2-ab77-c5565c63759e tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:21.812652 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8b88a62e-bb72-4383-8f8b-eb30d9b2c835 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:21.813019 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-ee69e93b-0850-4bd2-ab77-c5565c63759e tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:21.819541 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ee69e93b-0850-4bd2-ab77-c5565c63759e tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:21.820701 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ee69e93b-0850-4bd2-ab77-c5565c63759e tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:21.821527 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ee69e93b-0850-4bd2-ab77-c5565c63759e tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:21.821978 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ee69e93b-0850-4bd2-ab77-c5565c63759e tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:22.056543 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-8b88a62e-bb72-4383-8f8b-eb30d9b2c835 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:22.066287 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-8b88a62e-bb72-4383-8f8b-eb30d9b2c835 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:22.067910 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-ee69e93b-0850-4bd2-ab77-c5565c63759e tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:22.068114 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-8b88a62e-bb72-4383-8f8b-eb30d9b2c835 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:22.069632 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-8b88a62e-bb72-4383-8f8b-eb30d9b2c835 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1722 microversion: 2.20 time: 0.272791 Jun 17 08:54:22.070385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 175/338] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:21 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:22.076393 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-ee69e93b-0850-4bd2-ab77-c5565c63759e tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1359 microversion: 2.1 time: 0.268551 Jun 17 08:54:22.076990 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 164/339] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:21 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1359 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:22.268990 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-1458b795-ac3e-42fc-b4e8-54881ed01611 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:22.269847 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-e9931539-d511-4a74-88f9-3c511796b454 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:22.269973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-1458b795-ac3e-42fc-b4e8-54881ed01611 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:22.270479 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-e9931539-d511-4a74-88f9-3c511796b454 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:22.277366 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1458b795-ac3e-42fc-b4e8-54881ed01611 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:22.277582 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e9931539-d511-4a74-88f9-3c511796b454 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:22.277817 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1458b795-ac3e-42fc-b4e8-54881ed01611 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:22.277977 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e9931539-d511-4a74-88f9-3c511796b454 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:22.278713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e9931539-d511-4a74-88f9-3c511796b454 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:22.278907 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1458b795-ac3e-42fc-b4e8-54881ed01611 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:22.279150 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e9931539-d511-4a74-88f9-3c511796b454 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:22.279422 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1458b795-ac3e-42fc-b4e8-54881ed01611 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:22.528755 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-1458b795-ac3e-42fc-b4e8-54881ed01611 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:22.536593 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-1458b795-ac3e-42fc-b4e8-54881ed01611 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.271870 Jun 17 08:54:22.537490 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-e9931539-d511-4a74-88f9-3c511796b454 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:22.546988 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-e9931539-d511-4a74-88f9-3c511796b454 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.280678 Jun 17 08:54:22.555985 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 165/340] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:22 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:22.556190 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 176/341] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:22 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:22.780800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-12fdbe4d-e4f2-4d79-b186-0492dd73b391 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:22.781324 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-12fdbe4d-e4f2-4d79-b186-0492dd73b391 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:22.785352 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-b5509e31-c98d-4077-bc18-330e54658c6a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:22.787052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-b5509e31-c98d-4077-bc18-330e54658c6a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:22.787642 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-12fdbe4d-e4f2-4d79-b186-0492dd73b391 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:22.788362 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-12fdbe4d-e4f2-4d79-b186-0492dd73b391 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:22.789599 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-12fdbe4d-e4f2-4d79-b186-0492dd73b391 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:22.790049 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-12fdbe4d-e4f2-4d79-b186-0492dd73b391 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:22.794333 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b5509e31-c98d-4077-bc18-330e54658c6a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:22.794866 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b5509e31-c98d-4077-bc18-330e54658c6a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:22.795853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b5509e31-c98d-4077-bc18-330e54658c6a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:22.796359 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b5509e31-c98d-4077-bc18-330e54658c6a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:23.008409 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-12fdbe4d-e4f2-4d79-b186-0492dd73b391 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:23.012044 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-b5509e31-c98d-4077-bc18-330e54658c6a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:23.017591 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-12fdbe4d-e4f2-4d79-b186-0492dd73b391 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1315 microversion: 2.1 time: 0.241030 Jun 17 08:54:23.018243 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 166/342] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:22 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:23.020269 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-b5509e31-c98d-4077-bc18-330e54658c6a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.238925 Jun 17 08:54:23.020850 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 177/343] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:22 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:23.089892 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d099c4d9-d791-4c2d-acb5-c467a9f2fb03 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:23.090571 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-d099c4d9-d791-4c2d-acb5-c467a9f2fb03 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:23.097965 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d099c4d9-d791-4c2d-acb5-c467a9f2fb03 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:23.098477 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d099c4d9-d791-4c2d-acb5-c467a9f2fb03 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:23.099371 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d099c4d9-d791-4c2d-acb5-c467a9f2fb03 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:23.099884 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d099c4d9-d791-4c2d-acb5-c467a9f2fb03 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:23.102738 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-910149c4-e1b9-4db0-a1f5-614e45c12d00 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:23.103672 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-910149c4-e1b9-4db0-a1f5-614e45c12d00 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:23.123168 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-910149c4-e1b9-4db0-a1f5-614e45c12d00 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:23.123740 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-910149c4-e1b9-4db0-a1f5-614e45c12d00 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:23.124634 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-910149c4-e1b9-4db0-a1f5-614e45c12d00 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:23.125134 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-910149c4-e1b9-4db0-a1f5-614e45c12d00 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:23.339648 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d099c4d9-d791-4c2d-acb5-c467a9f2fb03 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:23.352507 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d099c4d9-d791-4c2d-acb5-c467a9f2fb03 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:23.354818 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d099c4d9-d791-4c2d-acb5-c467a9f2fb03 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:23.356340 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-d099c4d9-d791-4c2d-acb5-c467a9f2fb03 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1722 microversion: 2.20 time: 0.271083 Jun 17 08:54:23.369242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 167/344] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:23 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1722 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:23.373278 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-e8fc857e-47af-48bd-8ca0-69896f8c9723 req-c5bee484-bb90-43bd-a634-6c7e862c6100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e32781c-7056-4c56-a02d-4c94cbc414f8", "tag": "3b983d08-82e5-4031-8c13-d190ca57fc87"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:54:23.375774 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-910149c4-e1b9-4db0-a1f5-614e45c12d00 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:23.382141 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-e8fc857e-47af-48bd-8ca0-69896f8c9723 req-c5bee484-bb90-43bd-a634-6c7e862c6100 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:23.382755 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-e8fc857e-47af-48bd-8ca0-69896f8c9723 req-c5bee484-bb90-43bd-a634-6c7e862c6100 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:23.384125 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-910149c4-e1b9-4db0-a1f5-614e45c12d00 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1359 microversion: 2.1 time: 0.291587 Jun 17 08:54:23.384758 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 178/345] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:23 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1359 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:23.394280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-e8fc857e-47af-48bd-8ca0-69896f8c9723 req-c5bee484-bb90-43bd-a634-6c7e862c6100 service nova] Creating event network-changed:3b983d08-82e5-4031-8c13-d190ca57fc87 for instance 8e32781c-7056-4c56-a02d-4c94cbc414f8 on hv-cinder-79760 Jun 17 08:54:23.399666 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-e8fc857e-47af-48bd-8ca0-69896f8c9723 req-c5bee484-bb90-43bd-a634-6c7e862c6100 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031039 Jun 17 08:54:23.400227 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 168/346] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:54:23.554190 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-dd327e90-9622-4742-a25e-c253beed71a7 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:23.555734 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-dd327e90-9622-4742-a25e-c253beed71a7 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:23.568921 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-fe2630f1-2bb7-4053-aca6-dc9d11274284 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:23.569640 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-fe2630f1-2bb7-4053-aca6-dc9d11274284 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:23.572156 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dd327e90-9622-4742-a25e-c253beed71a7 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:23.572629 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dd327e90-9622-4742-a25e-c253beed71a7 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:23.573510 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dd327e90-9622-4742-a25e-c253beed71a7 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:23.573958 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dd327e90-9622-4742-a25e-c253beed71a7 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:23.576734 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fe2630f1-2bb7-4053-aca6-dc9d11274284 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:23.577436 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fe2630f1-2bb7-4053-aca6-dc9d11274284 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:23.578552 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fe2630f1-2bb7-4053-aca6-dc9d11274284 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:23.579005 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fe2630f1-2bb7-4053-aca6-dc9d11274284 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:23.813209 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-fe2630f1-2bb7-4053-aca6-dc9d11274284 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:23.822577 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-fe2630f1-2bb7-4053-aca6-dc9d11274284 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.258070 Jun 17 08:54:23.823428 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 169/347] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:23 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:23.828305 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-dd327e90-9622-4742-a25e-c253beed71a7 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:23.840206 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-dd327e90-9622-4742-a25e-c253beed71a7 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.290559 Jun 17 08:54:23.841128 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 179/348] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:23 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:24.035412 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-03b35942-f73a-446e-9cec-b868af56713b tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:24.036156 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-03b35942-f73a-446e-9cec-b868af56713b tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:24.039142 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-8e622bf9-7e96-435e-b538-30650edae766 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:24.040723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-8e622bf9-7e96-435e-b538-30650edae766 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:24.047884 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8e622bf9-7e96-435e-b538-30650edae766 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:24.048640 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-03b35942-f73a-446e-9cec-b868af56713b tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:24.049115 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8e622bf9-7e96-435e-b538-30650edae766 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:24.050251 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8e622bf9-7e96-435e-b538-30650edae766 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:24.050799 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-03b35942-f73a-446e-9cec-b868af56713b tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:24.051263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8e622bf9-7e96-435e-b538-30650edae766 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:24.051836 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-03b35942-f73a-446e-9cec-b868af56713b tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:24.055540 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-03b35942-f73a-446e-9cec-b868af56713b tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:24.337912 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-8e622bf9-7e96-435e-b538-30650edae766 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:24.345999 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-8e622bf9-7e96-435e-b538-30650edae766 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.312330 Jun 17 08:54:24.346813 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 180/349] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:24 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:24.348914 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-03b35942-f73a-446e-9cec-b868af56713b tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:24.357848 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-bd1deb45-6ae4-4d38-86a3-e61c6ff6774a req-2f28e165-4641-4b83-8f67-c46bbe44abf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397d996b-b163-4a47-856e-f2aca2ae6976", "name": "network-vif-unplugged", "status": "completed", "tag": "051f4b45-cbb1-44c1-92a3-54becef75c28"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:54:24.361344 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-03b35942-f73a-446e-9cec-b868af56713b tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1315 microversion: 2.1 time: 0.330410 Jun 17 08:54:24.361476 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 170/350] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:24 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:24.373110 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-bd1deb45-6ae4-4d38-86a3-e61c6ff6774a req-2f28e165-4641-4b83-8f67-c46bbe44abf1 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:24.373980 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-bd1deb45-6ae4-4d38-86a3-e61c6ff6774a req-2f28e165-4641-4b83-8f67-c46bbe44abf1 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:24.378627 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-01bc32c6-c99c-4969-915a-7fba04510eed tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:24.382770 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-01bc32c6-c99c-4969-915a-7fba04510eed tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:24.390782 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-bd1deb45-6ae4-4d38-86a3-e61c6ff6774a req-2f28e165-4641-4b83-8f67-c46bbe44abf1 service nova] Creating event network-vif-unplugged:051f4b45-cbb1-44c1-92a3-54becef75c28 for instance 397d996b-b163-4a47-856e-f2aca2ae6976 on hv-cinder-79760 Jun 17 08:54:24.395912 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-01bc32c6-c99c-4969-915a-7fba04510eed tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:24.396367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-01bc32c6-c99c-4969-915a-7fba04510eed tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:24.397172 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-01bc32c6-c99c-4969-915a-7fba04510eed tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:24.397509 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-bd1deb45-6ae4-4d38-86a3-e61c6ff6774a req-2f28e165-4641-4b83-8f67-c46bbe44abf1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049109 Jun 17 08:54:24.397644 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-01bc32c6-c99c-4969-915a-7fba04510eed tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:24.400185 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 181/351] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:54:24.407594 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-7f81fb3a-18f3-441e-a8e9-f3579339199d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:24.409050 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-7f81fb3a-18f3-441e-a8e9-f3579339199d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:24.433007 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7f81fb3a-18f3-441e-a8e9-f3579339199d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:24.434459 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7f81fb3a-18f3-441e-a8e9-f3579339199d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:24.435651 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7f81fb3a-18f3-441e-a8e9-f3579339199d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:24.436397 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7f81fb3a-18f3-441e-a8e9-f3579339199d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:24.588104 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-01bc32c6-c99c-4969-915a-7fba04510eed tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lazy-loading 'services' on Instance uuid edcd67d0-7a53-4e37-a947-a077ffd9bd71 {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:54:24.624085 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-7f81fb3a-18f3-441e-a8e9-f3579339199d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:24.636241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-7f81fb3a-18f3-441e-a8e9-f3579339199d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:24.637849 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-7f81fb3a-18f3-441e-a8e9-f3579339199d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:24.639056 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-7f81fb3a-18f3-441e-a8e9-f3579339199d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1722 microversion: 2.20 time: 0.237388 Jun 17 08:54:24.651328 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 182/352] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:24 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:24.651328 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a71eaa89-f472-4e43-83c7-9555ffacf3c0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:24.651328 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a71eaa89-f472-4e43-83c7-9555ffacf3c0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:24.654266 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a71eaa89-f472-4e43-83c7-9555ffacf3c0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:24.654846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a71eaa89-f472-4e43-83c7-9555ffacf3c0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:24.655809 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a71eaa89-f472-4e43-83c7-9555ffacf3c0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:24.656319 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a71eaa89-f472-4e43-83c7-9555ffacf3c0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:24.832641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a71eaa89-f472-4e43-83c7-9555ffacf3c0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:24.840343 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a71eaa89-f472-4e43-83c7-9555ffacf3c0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1359 microversion: 2.1 time: 0.199712 Jun 17 08:54:24.840906 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 183/353] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:24 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:24.845260 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-07f00790-5d9d-4267-bba9-1b7b76cbc0c4 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:24.846002 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-07f00790-5d9d-4267-bba9-1b7b76cbc0c4 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:24.855329 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-07f00790-5d9d-4267-bba9-1b7b76cbc0c4 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:24.856005 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-07f00790-5d9d-4267-bba9-1b7b76cbc0c4 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:24.856796 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-07f00790-5d9d-4267-bba9-1b7b76cbc0c4 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:24.857240 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-07f00790-5d9d-4267-bba9-1b7b76cbc0c4 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:24.858624 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-01bc32c6-c99c-4969-915a-7fba04510eed tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "DELETE /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71/os-volume_attachments/e9856711-49a8-4477-a524-a2f8e7f909df" status: 202 len: 0 microversion: 2.1 time: 0.489344 Jun 17 08:54:24.859232 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 171/354] 10.222.0.78 () {58 vars in 1415 bytes} [Fri Jun 17 08:54:24 2022] DELETE /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71/os-volume_attachments/e9856711-49a8-4477-a524-a2f8e7f909df => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:54:24.864542 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-54bfb9c1-394c-40b6-bcf3-0c19b4169426 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:24.865245 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-54bfb9c1-394c-40b6-bcf3-0c19b4169426 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:24.874029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-54bfb9c1-394c-40b6-bcf3-0c19b4169426 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:24.874664 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-54bfb9c1-394c-40b6-bcf3-0c19b4169426 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:24.875572 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-54bfb9c1-394c-40b6-bcf3-0c19b4169426 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:24.876111 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-54bfb9c1-394c-40b6-bcf3-0c19b4169426 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:25.127739 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-54bfb9c1-394c-40b6-bcf3-0c19b4169426 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:25.136045 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-54bfb9c1-394c-40b6-bcf3-0c19b4169426 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.275560 Jun 17 08:54:25.136831 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 172/355] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:24 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:25.139092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-07f00790-5d9d-4267-bba9-1b7b76cbc0c4 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:25.147279 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-07f00790-5d9d-4267-bba9-1b7b76cbc0c4 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.305324 Jun 17 08:54:25.148509 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 184/356] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:24 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:25.369381 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-6f8273a4-9ed7-43f3-adf8-32a5055353b4 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:25.369913 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-6f8273a4-9ed7-43f3-adf8-32a5055353b4 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:25.377864 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6f8273a4-9ed7-43f3-adf8-32a5055353b4 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:25.378297 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-207c08d8-0045-441e-aad0-fcaaafcd72ca tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:25.378423 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6f8273a4-9ed7-43f3-adf8-32a5055353b4 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:25.379091 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-207c08d8-0045-441e-aad0-fcaaafcd72ca tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:25.379197 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6f8273a4-9ed7-43f3-adf8-32a5055353b4 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:25.379645 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6f8273a4-9ed7-43f3-adf8-32a5055353b4 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:25.385954 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-207c08d8-0045-441e-aad0-fcaaafcd72ca tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:25.386403 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-207c08d8-0045-441e-aad0-fcaaafcd72ca tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:25.387168 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-207c08d8-0045-441e-aad0-fcaaafcd72ca tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:25.387907 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-207c08d8-0045-441e-aad0-fcaaafcd72ca tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:25.584722 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-6f8273a4-9ed7-43f3-adf8-32a5055353b4 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:25.593406 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-6f8273a4-9ed7-43f3-adf8-32a5055353b4 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.228652 Jun 17 08:54:25.599722 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 173/357] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:25 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:25.613576 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-207c08d8-0045-441e-aad0-fcaaafcd72ca tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:25.622319 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-207c08d8-0045-441e-aad0-fcaaafcd72ca tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1315 microversion: 2.1 time: 0.247922 Jun 17 08:54:25.622953 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 185/358] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:25 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:25.658257 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-490ea949-16fa-4eb0-8d54-bc4823262301 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:25.658871 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-490ea949-16fa-4eb0-8d54-bc4823262301 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:25.665126 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-490ea949-16fa-4eb0-8d54-bc4823262301 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:25.665568 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-490ea949-16fa-4eb0-8d54-bc4823262301 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:25.666344 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-490ea949-16fa-4eb0-8d54-bc4823262301 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:25.666778 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-490ea949-16fa-4eb0-8d54-bc4823262301 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:25.810935 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-490ea949-16fa-4eb0-8d54-bc4823262301 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:25.821841 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-490ea949-16fa-4eb0-8d54-bc4823262301 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:25.823715 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-490ea949-16fa-4eb0-8d54-bc4823262301 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:25.824954 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-490ea949-16fa-4eb0-8d54-bc4823262301 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1722 microversion: 2.20 time: 0.170596 Jun 17 08:54:25.825580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 174/359] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:25 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:25.858410 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-9da155cc-5d6f-4e96-9c40-01cad1c2b78f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:25.859716 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-9da155cc-5d6f-4e96-9c40-01cad1c2b78f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:25.874643 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9da155cc-5d6f-4e96-9c40-01cad1c2b78f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:25.875485 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9da155cc-5d6f-4e96-9c40-01cad1c2b78f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:25.876580 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9da155cc-5d6f-4e96-9c40-01cad1c2b78f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:25.877242 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9da155cc-5d6f-4e96-9c40-01cad1c2b78f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:26.039540 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-9da155cc-5d6f-4e96-9c40-01cad1c2b78f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:26.042205 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=100 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:26.052100 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-9da155cc-5d6f-4e96-9c40-01cad1c2b78f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1359 microversion: 2.1 time: 0.197402 Jun 17 08:54:26.053179 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 186/360] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:25 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:26.153059 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-668a7954-c088-40cc-b0b1-d8ac70403768 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:26.153935 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-668a7954-c088-40cc-b0b1-d8ac70403768 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:26.162736 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-668a7954-c088-40cc-b0b1-d8ac70403768 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:26.163441 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-668a7954-c088-40cc-b0b1-d8ac70403768 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:26.165307 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-668a7954-c088-40cc-b0b1-d8ac70403768 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:26.165786 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-668a7954-c088-40cc-b0b1-d8ac70403768 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:26.168775 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-72319066-fad0-43bf-ab7c-6390b775098a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:26.169839 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-72319066-fad0-43bf-ab7c-6390b775098a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:26.177338 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-72319066-fad0-43bf-ab7c-6390b775098a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:26.178211 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-72319066-fad0-43bf-ab7c-6390b775098a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:26.179220 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-72319066-fad0-43bf-ab7c-6390b775098a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:26.181048 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-72319066-fad0-43bf-ab7c-6390b775098a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:26.380470 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-668a7954-c088-40cc-b0b1-d8ac70403768 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:26.388452 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-72319066-fad0-43bf-ab7c-6390b775098a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:26.391447 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-668a7954-c088-40cc-b0b1-d8ac70403768 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.243035 Jun 17 08:54:26.393161 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 175/361] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:26 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:26.397347 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-72319066-fad0-43bf-ab7c-6390b775098a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.236263 Jun 17 08:54:26.398044 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 187/362] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:26 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:26.616607 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3aa5e2b0-bf5a-4dd7-b58e-e5ac999cc070 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:26.618338 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-3aa5e2b0-bf5a-4dd7-b58e-e5ac999cc070 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:26.625026 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3aa5e2b0-bf5a-4dd7-b58e-e5ac999cc070 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:26.625814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3aa5e2b0-bf5a-4dd7-b58e-e5ac999cc070 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:26.626728 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3aa5e2b0-bf5a-4dd7-b58e-e5ac999cc070 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:26.627430 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3aa5e2b0-bf5a-4dd7-b58e-e5ac999cc070 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:26.659053 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:26.661362 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-19e190ed-4650-49dd-b8f5-e7b86e5434a7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:26.662326 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-19e190ed-4650-49dd-b8f5-e7b86e5434a7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:26.683724 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-19e190ed-4650-49dd-b8f5-e7b86e5434a7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:26.684428 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-19e190ed-4650-49dd-b8f5-e7b86e5434a7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:26.685218 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-19e190ed-4650-49dd-b8f5-e7b86e5434a7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:26.689736 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-19e190ed-4650-49dd-b8f5-e7b86e5434a7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:26.887173 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3aa5e2b0-bf5a-4dd7-b58e-e5ac999cc070 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:26.901542 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-19e190ed-4650-49dd-b8f5-e7b86e5434a7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:26.904682 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-3aa5e2b0-bf5a-4dd7-b58e-e5ac999cc070 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.293499 Jun 17 08:54:26.905720 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 176/363] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:26 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:26.911570 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-faf0f230-f4ae-4653-879c-587f40c5ede5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:26.912277 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-faf0f230-f4ae-4653-879c-587f40c5ede5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:26.919813 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-19e190ed-4650-49dd-b8f5-e7b86e5434a7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1315 microversion: 2.1 time: 0.265162 Jun 17 08:54:26.920012 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-faf0f230-f4ae-4653-879c-587f40c5ede5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:26.920333 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-faf0f230-f4ae-4653-879c-587f40c5ede5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:26.920930 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 188/364] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:26 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:26.930254 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-faf0f230-f4ae-4653-879c-587f40c5ede5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:26.930254 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-faf0f230-f4ae-4653-879c-587f40c5ede5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:27.076209 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-2c2067c4-9825-44ed-a86b-893b5a33c56f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:27.080946 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-2c2067c4-9825-44ed-a86b-893b5a33c56f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:27.084831 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2c2067c4-9825-44ed-a86b-893b5a33c56f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:27.085287 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2c2067c4-9825-44ed-a86b-893b5a33c56f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:27.086247 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2c2067c4-9825-44ed-a86b-893b5a33c56f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:27.086749 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2c2067c4-9825-44ed-a86b-893b5a33c56f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:27.101574 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-faf0f230-f4ae-4653-879c-587f40c5ede5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:27.110690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-faf0f230-f4ae-4653-879c-587f40c5ede5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:27.113375 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-faf0f230-f4ae-4653-879c-587f40c5ede5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:27.114572 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-faf0f230-f4ae-4653-879c-587f40c5ede5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1722 microversion: 2.20 time: 0.207846 Jun 17 08:54:27.115773 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 177/365] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:26 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:27.262790 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-2c2067c4-9825-44ed-a86b-893b5a33c56f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:27.270421 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-2c2067c4-9825-44ed-a86b-893b5a33c56f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1359 microversion: 2.1 time: 0.200275 Jun 17 08:54:27.279515 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 189/366] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:27 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:27.420277 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-ffaad560-4654-4ab5-ad6c-00bd6f96cf61 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:27.420786 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-7afe6a96-5cf3-47d9-b9df-da27ad2bef22 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:27.420899 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-ffaad560-4654-4ab5-ad6c-00bd6f96cf61 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:27.421408 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-7afe6a96-5cf3-47d9-b9df-da27ad2bef22 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:27.428059 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7afe6a96-5cf3-47d9-b9df-da27ad2bef22 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:27.428861 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7afe6a96-5cf3-47d9-b9df-da27ad2bef22 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:27.430425 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7afe6a96-5cf3-47d9-b9df-da27ad2bef22 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:27.431062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7afe6a96-5cf3-47d9-b9df-da27ad2bef22 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:27.433662 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ffaad560-4654-4ab5-ad6c-00bd6f96cf61 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:27.434627 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ffaad560-4654-4ab5-ad6c-00bd6f96cf61 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:27.435645 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ffaad560-4654-4ab5-ad6c-00bd6f96cf61 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:27.439165 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ffaad560-4654-4ab5-ad6c-00bd6f96cf61 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:27.669072 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-7afe6a96-5cf3-47d9-b9df-da27ad2bef22 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:27.679589 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-7afe6a96-5cf3-47d9-b9df-da27ad2bef22 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.263265 Jun 17 08:54:27.682678 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 178/367] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:27 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:27.684057 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-ffaad560-4654-4ab5-ad6c-00bd6f96cf61 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:27.692631 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-ffaad560-4654-4ab5-ad6c-00bd6f96cf61 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.276483 Jun 17 08:54:27.696470 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 190/368] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:27 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:27.922507 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-990b97d4-eea6-4e1e-b7bb-aba9af4911cb tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:27.923066 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-990b97d4-eea6-4e1e-b7bb-aba9af4911cb tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:27.932838 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-990b97d4-eea6-4e1e-b7bb-aba9af4911cb tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:27.933040 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-990b97d4-eea6-4e1e-b7bb-aba9af4911cb tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:27.933676 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-990b97d4-eea6-4e1e-b7bb-aba9af4911cb tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:27.934442 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-990b97d4-eea6-4e1e-b7bb-aba9af4911cb tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:27.939033 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-8fad5f45-3747-4080-8956-2a9d2b1daf75 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:27.940263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-8fad5f45-3747-4080-8956-2a9d2b1daf75 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:27.947846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8fad5f45-3747-4080-8956-2a9d2b1daf75 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:27.948637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8fad5f45-3747-4080-8956-2a9d2b1daf75 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:27.949576 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8fad5f45-3747-4080-8956-2a9d2b1daf75 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:27.950239 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8fad5f45-3747-4080-8956-2a9d2b1daf75 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:28.142691 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-990b97d4-eea6-4e1e-b7bb-aba9af4911cb tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:28.153187 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-990b97d4-eea6-4e1e-b7bb-aba9af4911cb tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.234747 Jun 17 08:54:28.170134 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 179/369] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:27 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:28.178026 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-842771c3-a5a2-4ba1-bea2-b7ca6f5bd12a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:28.179161 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-842771c3-a5a2-4ba1-bea2-b7ca6f5bd12a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:28.182305 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-8fad5f45-3747-4080-8956-2a9d2b1daf75 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:28.191203 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-8fad5f45-3747-4080-8956-2a9d2b1daf75 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1315 microversion: 2.1 time: 0.256110 Jun 17 08:54:28.202042 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 191/370] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:27 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:28.202697 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-842771c3-a5a2-4ba1-bea2-b7ca6f5bd12a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:28.203157 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-842771c3-a5a2-4ba1-bea2-b7ca6f5bd12a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:28.203976 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-842771c3-a5a2-4ba1-bea2-b7ca6f5bd12a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:28.204418 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-842771c3-a5a2-4ba1-bea2-b7ca6f5bd12a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:28.291227 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-d9ba871e-7d5e-4844-a88d-c6a8bcc2c1b3 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:28.291885 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-d9ba871e-7d5e-4844-a88d-c6a8bcc2c1b3 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:28.298499 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d9ba871e-7d5e-4844-a88d-c6a8bcc2c1b3 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:28.298955 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d9ba871e-7d5e-4844-a88d-c6a8bcc2c1b3 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:28.299908 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d9ba871e-7d5e-4844-a88d-c6a8bcc2c1b3 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:28.300353 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d9ba871e-7d5e-4844-a88d-c6a8bcc2c1b3 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:28.417839 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-842771c3-a5a2-4ba1-bea2-b7ca6f5bd12a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:28.429149 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-842771c3-a5a2-4ba1-bea2-b7ca6f5bd12a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:28.430959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-842771c3-a5a2-4ba1-bea2-b7ca6f5bd12a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:28.432444 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-842771c3-a5a2-4ba1-bea2-b7ca6f5bd12a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1722 microversion: 2.20 time: 0.262851 Jun 17 08:54:28.433033 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 180/371] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:28 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:28.499854 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-d9ba871e-7d5e-4844-a88d-c6a8bcc2c1b3 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:28.508088 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-d9ba871e-7d5e-4844-a88d-c6a8bcc2c1b3 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1359 microversion: 2.1 time: 0.223373 Jun 17 08:54:28.508585 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 192/372] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:28 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:28.698660 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-145a0ea6-17cc-4a70-85a1-ef6e25f4a8ca tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:28.699314 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-145a0ea6-17cc-4a70-85a1-ef6e25f4a8ca tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:28.705415 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-145a0ea6-17cc-4a70-85a1-ef6e25f4a8ca tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:28.705858 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-145a0ea6-17cc-4a70-85a1-ef6e25f4a8ca tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:28.706621 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-145a0ea6-17cc-4a70-85a1-ef6e25f4a8ca tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:28.707058 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-145a0ea6-17cc-4a70-85a1-ef6e25f4a8ca tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:28.720101 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-8f7466d5-4332-4b6d-a02d-b4184ab778cf tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:28.720724 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-8f7466d5-4332-4b6d-a02d-b4184ab778cf tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:28.728024 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8f7466d5-4332-4b6d-a02d-b4184ab778cf tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:28.728473 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8f7466d5-4332-4b6d-a02d-b4184ab778cf tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:28.729254 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8f7466d5-4332-4b6d-a02d-b4184ab778cf tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:28.729743 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8f7466d5-4332-4b6d-a02d-b4184ab778cf tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:28.903906 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-145a0ea6-17cc-4a70-85a1-ef6e25f4a8ca tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:28.911991 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-145a0ea6-17cc-4a70-85a1-ef6e25f4a8ca tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.216874 Jun 17 08:54:28.911991 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 181/373] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:28 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:28.938929 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-8f7466d5-4332-4b6d-a02d-b4184ab778cf tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:28.946952 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-8f7466d5-4332-4b6d-a02d-b4184ab778cf tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.230716 Jun 17 08:54:28.947621 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 193/374] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:28 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:29.177892 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-857c7027-18fe-4b47-87db-e5497e6d3552 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:29.178602 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-857c7027-18fe-4b47-87db-e5497e6d3552 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:29.195603 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-857c7027-18fe-4b47-87db-e5497e6d3552 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:29.196273 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-857c7027-18fe-4b47-87db-e5497e6d3552 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:29.197130 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-857c7027-18fe-4b47-87db-e5497e6d3552 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:29.197604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-857c7027-18fe-4b47-87db-e5497e6d3552 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:29.209766 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-4833c2a7-1f9c-4220-8efb-7526fe12e0dd tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:29.212587 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-4833c2a7-1f9c-4220-8efb-7526fe12e0dd tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:29.231795 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4833c2a7-1f9c-4220-8efb-7526fe12e0dd tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:29.232606 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4833c2a7-1f9c-4220-8efb-7526fe12e0dd tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:29.234260 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4833c2a7-1f9c-4220-8efb-7526fe12e0dd tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:29.234907 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4833c2a7-1f9c-4220-8efb-7526fe12e0dd tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:29.438079 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-857c7027-18fe-4b47-87db-e5497e6d3552 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:29.447925 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-857c7027-18fe-4b47-87db-e5497e6d3552 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.273605 Jun 17 08:54:29.449297 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 182/375] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:29 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:29.455539 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-2731a436-8d9b-4795-93a7-13b4d2e16b82 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:29.456508 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-2731a436-8d9b-4795-93a7-13b4d2e16b82 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:29.472731 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2731a436-8d9b-4795-93a7-13b4d2e16b82 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:29.473187 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2731a436-8d9b-4795-93a7-13b4d2e16b82 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:29.474746 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2731a436-8d9b-4795-93a7-13b4d2e16b82 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:29.475256 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2731a436-8d9b-4795-93a7-13b4d2e16b82 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:29.482221 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-4833c2a7-1f9c-4220-8efb-7526fe12e0dd tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:29.491659 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-4833c2a7-1f9c-4220-8efb-7526fe12e0dd tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1315 microversion: 2.1 time: 0.286122 Jun 17 08:54:29.493986 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 194/376] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:29 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:29.527050 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e4375b2b-79bb-4824-930c-b8f559a9db51 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:29.527803 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-e4375b2b-79bb-4824-930c-b8f559a9db51 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:29.534362 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e4375b2b-79bb-4824-930c-b8f559a9db51 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:29.534814 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e4375b2b-79bb-4824-930c-b8f559a9db51 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:29.535620 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e4375b2b-79bb-4824-930c-b8f559a9db51 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:29.536067 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e4375b2b-79bb-4824-930c-b8f559a9db51 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:29.676104 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2731a436-8d9b-4795-93a7-13b4d2e16b82 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:29.684912 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2731a436-8d9b-4795-93a7-13b4d2e16b82 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:29.686714 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2731a436-8d9b-4795-93a7-13b4d2e16b82 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:29.687912 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-2731a436-8d9b-4795-93a7-13b4d2e16b82 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1722 microversion: 2.20 time: 0.237467 Jun 17 08:54:29.688475 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 183/377] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:29 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:29.711342 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e4375b2b-79bb-4824-930c-b8f559a9db51 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:29.718641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-e4375b2b-79bb-4824-930c-b8f559a9db51 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1359 microversion: 2.1 time: 0.196919 Jun 17 08:54:29.719202 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 195/378] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:29 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:29.934338 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0b00a89b-83c5-4b36-b2a3-9c28b11ec754 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:29.935035 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0b00a89b-83c5-4b36-b2a3-9c28b11ec754 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:29.941185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0b00a89b-83c5-4b36-b2a3-9c28b11ec754 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:29.941631 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0b00a89b-83c5-4b36-b2a3-9c28b11ec754 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:29.942402 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0b00a89b-83c5-4b36-b2a3-9c28b11ec754 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:29.943153 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0b00a89b-83c5-4b36-b2a3-9c28b11ec754 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:29.964206 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-648c5f91-6fce-497b-846a-28f22699e858 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:29.965305 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-648c5f91-6fce-497b-846a-28f22699e858 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:29.971780 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-648c5f91-6fce-497b-846a-28f22699e858 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:29.972226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-648c5f91-6fce-497b-846a-28f22699e858 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:29.973004 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-648c5f91-6fce-497b-846a-28f22699e858 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:29.973435 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-648c5f91-6fce-497b-846a-28f22699e858 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:30.162864 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0b00a89b-83c5-4b36-b2a3-9c28b11ec754 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:30.177748 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0b00a89b-83c5-4b36-b2a3-9c28b11ec754 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.247483 Jun 17 08:54:30.189658 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 184/379] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:29 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:30.197997 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-648c5f91-6fce-497b-846a-28f22699e858 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:30.205648 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-648c5f91-6fce-497b-846a-28f22699e858 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.245969 Jun 17 08:54:30.215982 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 196/380] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:29 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:30.465056 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-04cc58be-2acb-44a5-9eb7-0b7e36cff872 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:30.465705 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-04cc58be-2acb-44a5-9eb7-0b7e36cff872 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:30.472297 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-04cc58be-2acb-44a5-9eb7-0b7e36cff872 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:30.472781 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-04cc58be-2acb-44a5-9eb7-0b7e36cff872 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:30.473549 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-04cc58be-2acb-44a5-9eb7-0b7e36cff872 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:30.473986 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-04cc58be-2acb-44a5-9eb7-0b7e36cff872 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:30.516118 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-d9a6fc2b-541e-4227-8eb2-6a6096af2530 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:30.523774 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-d9a6fc2b-541e-4227-8eb2-6a6096af2530 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:30.538472 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d9a6fc2b-541e-4227-8eb2-6a6096af2530 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:30.539923 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d9a6fc2b-541e-4227-8eb2-6a6096af2530 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:30.540902 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d9a6fc2b-541e-4227-8eb2-6a6096af2530 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:30.541498 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d9a6fc2b-541e-4227-8eb2-6a6096af2530 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:30.694702 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-04cc58be-2acb-44a5-9eb7-0b7e36cff872 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:30.705667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-04cc58be-2acb-44a5-9eb7-0b7e36cff872 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.244766 Jun 17 08:54:30.706446 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 185/381] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:30 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:30.712253 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d2f7696d-9db2-4212-89db-f07cd7fdf7de tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:30.713084 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-d2f7696d-9db2-4212-89db-f07cd7fdf7de tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:30.719319 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d2f7696d-9db2-4212-89db-f07cd7fdf7de tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:30.723659 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d2f7696d-9db2-4212-89db-f07cd7fdf7de tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:30.723659 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d2f7696d-9db2-4212-89db-f07cd7fdf7de tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:30.723659 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d2f7696d-9db2-4212-89db-f07cd7fdf7de tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:30.728746 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-d9a6fc2b-541e-4227-8eb2-6a6096af2530 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:30.737280 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-d9a6fc2b-541e-4227-8eb2-6a6096af2530 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1315 microversion: 2.1 time: 0.230636 Jun 17 08:54:30.738139 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 197/382] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:30 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:30.743774 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-d486a3c0-b929-485c-9051-2e185e1bc50d tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:30.744640 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-d486a3c0-b929-485c-9051-2e185e1bc50d tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:30.750789 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d486a3c0-b929-485c-9051-2e185e1bc50d tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:30.754417 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d486a3c0-b929-485c-9051-2e185e1bc50d tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:30.754417 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d486a3c0-b929-485c-9051-2e185e1bc50d tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:30.754417 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d486a3c0-b929-485c-9051-2e185e1bc50d tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:30.951645 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d2f7696d-9db2-4212-89db-f07cd7fdf7de tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:30.960203 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-d486a3c0-b929-485c-9051-2e185e1bc50d tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:30.964723 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d2f7696d-9db2-4212-89db-f07cd7fdf7de tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:30.968271 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d2f7696d-9db2-4212-89db-f07cd7fdf7de tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:30.968271 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-d2f7696d-9db2-4212-89db-f07cd7fdf7de tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1722 microversion: 2.20 time: 0.260215 Jun 17 08:54:30.969100 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-d486a3c0-b929-485c-9051-2e185e1bc50d tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1359 microversion: 2.1 time: 0.228871 Jun 17 08:54:30.969100 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 198/383] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:30 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:30.969578 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 186/384] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:30 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:31.195865 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-c0ae7340-84c1-443f-a604-847629bc2e22 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:31.196484 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-c0ae7340-84c1-443f-a604-847629bc2e22 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:31.198763 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_api:SELECT=100 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:31.203569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c0ae7340-84c1-443f-a604-847629bc2e22 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:31.204065 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c0ae7340-84c1-443f-a604-847629bc2e22 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:31.204838 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c0ae7340-84c1-443f-a604-847629bc2e22 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:31.205304 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c0ae7340-84c1-443f-a604-847629bc2e22 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:31.223395 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0c4a337b-c332-485d-806b-f1a2f45acba5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:31.223908 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0c4a337b-c332-485d-806b-f1a2f45acba5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:31.225763 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=100 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:31.231332 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0c4a337b-c332-485d-806b-f1a2f45acba5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:31.231801 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0c4a337b-c332-485d-806b-f1a2f45acba5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:31.232577 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0c4a337b-c332-485d-806b-f1a2f45acba5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:31.233015 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0c4a337b-c332-485d-806b-f1a2f45acba5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:31.427254 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c0ae7340-84c1-443f-a604-847629bc2e22 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:31.440849 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-c0ae7340-84c1-443f-a604-847629bc2e22 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.248904 Jun 17 08:54:31.443560 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 199/385] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:31 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:31.443716 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0c4a337b-c332-485d-806b-f1a2f45acba5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:31.455665 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0c4a337b-c332-485d-806b-f1a2f45acba5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.234286 Jun 17 08:54:31.455665 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 187/386] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:31 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:31.723994 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-9a2455ac-6185-4089-a851-f4259bbab24c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:31.724609 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-9a2455ac-6185-4089-a851-f4259bbab24c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:31.731571 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9a2455ac-6185-4089-a851-f4259bbab24c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:31.732054 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9a2455ac-6185-4089-a851-f4259bbab24c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:31.732825 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9a2455ac-6185-4089-a851-f4259bbab24c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:31.733295 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9a2455ac-6185-4089-a851-f4259bbab24c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:31.754266 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-7116986e-3b71-4f34-8a3f-b87e4cb1ae95 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:31.754879 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-7116986e-3b71-4f34-8a3f-b87e4cb1ae95 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:31.761453 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7116986e-3b71-4f34-8a3f-b87e4cb1ae95 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:31.761904 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7116986e-3b71-4f34-8a3f-b87e4cb1ae95 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:31.762675 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7116986e-3b71-4f34-8a3f-b87e4cb1ae95 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:31.763374 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7116986e-3b71-4f34-8a3f-b87e4cb1ae95 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:31.919550 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-9a2455ac-6185-4089-a851-f4259bbab24c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:31.927581 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-9a2455ac-6185-4089-a851-f4259bbab24c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.207332 Jun 17 08:54:31.928164 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 200/387] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:31 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:31.941485 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-7116986e-3b71-4f34-8a3f-b87e4cb1ae95 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:31.949986 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-7116986e-3b71-4f34-8a3f-b87e4cb1ae95 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1465 microversion: 2.1 time: 0.199506 Jun 17 08:54:31.950561 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 188/388] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:31 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1465 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:31.986295 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-9d4ac2ba-f3d5-42f5-b236-34430704eb32 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:31.986776 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-bd043065-f102-4cc8-bee3-ca97d8fdb95a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:31.987145 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-9d4ac2ba-f3d5-42f5-b236-34430704eb32 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:31.987725 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-bd043065-f102-4cc8-bee3-ca97d8fdb95a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:31.994281 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9d4ac2ba-f3d5-42f5-b236-34430704eb32 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:31.994743 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9d4ac2ba-f3d5-42f5-b236-34430704eb32 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:31.995576 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9d4ac2ba-f3d5-42f5-b236-34430704eb32 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:31.995707 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bd043065-f102-4cc8-bee3-ca97d8fdb95a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:31.996022 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9d4ac2ba-f3d5-42f5-b236-34430704eb32 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:31.996137 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bd043065-f102-4cc8-bee3-ca97d8fdb95a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:31.996804 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bd043065-f102-4cc8-bee3-ca97d8fdb95a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:31.997291 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bd043065-f102-4cc8-bee3-ca97d8fdb95a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:32.417727 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-bd043065-f102-4cc8-bee3-ca97d8fdb95a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:32.421903 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-9d4ac2ba-f3d5-42f5-b236-34430704eb32 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:32.426059 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-bd043065-f102-4cc8-bee3-ca97d8fdb95a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:32.429734 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-bd043065-f102-4cc8-bee3-ca97d8fdb95a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:32.429734 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-bd043065-f102-4cc8-bee3-ca97d8fdb95a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1722 microversion: 2.20 time: 0.446540 Jun 17 08:54:32.430079 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-9d4ac2ba-f3d5-42f5-b236-34430704eb32 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1359 microversion: 2.1 time: 0.447323 Jun 17 08:54:32.430184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 189/389] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:31 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1722 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:32.439877 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 201/390] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:31 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1359 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:32.440076 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-ffcf3d0d-2e2a-4a67-b54c-a8ad9f8c85de tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:32.440076 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-ffcf3d0d-2e2a-4a67-b54c-a8ad9f8c85de tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:32.442126 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ffcf3d0d-2e2a-4a67-b54c-a8ad9f8c85de tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:32.442571 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ffcf3d0d-2e2a-4a67-b54c-a8ad9f8c85de tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:32.443384 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ffcf3d0d-2e2a-4a67-b54c-a8ad9f8c85de tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:32.443830 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ffcf3d0d-2e2a-4a67-b54c-a8ad9f8c85de tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:32.463617 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-53b95880-7a7b-48b6-824d-d146e649cabc tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:32.464230 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-53b95880-7a7b-48b6-824d-d146e649cabc tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:32.470202 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-53b95880-7a7b-48b6-824d-d146e649cabc tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:32.470416 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-ffcf3d0d-2e2a-4a67-b54c-a8ad9f8c85de tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Going to try to terminate instance {{(pid=129875) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:54:32.470653 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-53b95880-7a7b-48b6-824d-d146e649cabc tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:32.471449 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-53b95880-7a7b-48b6-824d-d146e649cabc tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:32.471883 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-53b95880-7a7b-48b6-824d-d146e649cabc tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:32.606662 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-53b95880-7a7b-48b6-824d-d146e649cabc tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:32.614993 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-53b95880-7a7b-48b6-824d-d146e649cabc tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.155320 Jun 17 08:54:32.615622 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 202/391] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:32 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:32.620320 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-742bf62d-d09a-48fa-84a7-09cb4e7aa6ca tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:32.620937 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-742bf62d-d09a-48fa-84a7-09cb4e7aa6ca tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:32.629600 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-742bf62d-d09a-48fa-84a7-09cb4e7aa6ca tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:32.630081 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-742bf62d-d09a-48fa-84a7-09cb4e7aa6ca tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:32.630830 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-742bf62d-d09a-48fa-84a7-09cb4e7aa6ca tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:32.631266 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-742bf62d-d09a-48fa-84a7-09cb4e7aa6ca tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:32.646603 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=100 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:32.746662 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-ffcf3d0d-2e2a-4a67-b54c-a8ad9f8c85de tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "DELETE /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 204 len: 0 microversion: 2.1 time: 0.315252 Jun 17 08:54:32.747511 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 190/392] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 08:54:32 2022] DELETE /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:54:32.755723 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-deee7682-48dc-4840-9f40-14c0ae35e98f tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:32.756686 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-deee7682-48dc-4840-9f40-14c0ae35e98f tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:32.763913 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-deee7682-48dc-4840-9f40-14c0ae35e98f tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:32.764362 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-deee7682-48dc-4840-9f40-14c0ae35e98f tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:32.765136 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-deee7682-48dc-4840-9f40-14c0ae35e98f tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:32.765574 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-deee7682-48dc-4840-9f40-14c0ae35e98f tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:32.767876 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-742bf62d-d09a-48fa-84a7-09cb4e7aa6ca tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:32.775885 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-742bf62d-d09a-48fa-84a7-09cb4e7aa6ca tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.159269 Jun 17 08:54:32.776463 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 203/393] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:32 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:32.785173 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:32.897150 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-deee7682-48dc-4840-9f40-14c0ae35e98f tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:32.905662 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-deee7682-48dc-4840-9f40-14c0ae35e98f tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1471 microversion: 2.1 time: 0.154032 Jun 17 08:54:32.906246 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 191/394] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:32 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:32.945356 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-66bc9f52-eb8f-4982-ad36-53cbcc704136 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:32.945974 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-66bc9f52-eb8f-4982-ad36-53cbcc704136 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:32.952087 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-66bc9f52-eb8f-4982-ad36-53cbcc704136 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:32.953472 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-66bc9f52-eb8f-4982-ad36-53cbcc704136 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:32.953472 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-66bc9f52-eb8f-4982-ad36-53cbcc704136 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:32.953792 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-66bc9f52-eb8f-4982-ad36-53cbcc704136 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:33.126355 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-66bc9f52-eb8f-4982-ad36-53cbcc704136 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:33.134900 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-66bc9f52-eb8f-4982-ad36-53cbcc704136 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.193894 Jun 17 08:54:33.135509 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 204/395] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:32 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:33.448669 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-203f7714-6cab-44b8-a355-926729be13ed tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:33.449904 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-203f7714-6cab-44b8-a355-926729be13ed tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:33.450138 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-65a3e061-9142-4991-890e-9b8532f36607 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:33.451032 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-65a3e061-9142-4991-890e-9b8532f36607 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:33.457803 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-203f7714-6cab-44b8-a355-926729be13ed tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:33.458243 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-203f7714-6cab-44b8-a355-926729be13ed tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:33.458591 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-65a3e061-9142-4991-890e-9b8532f36607 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:33.459017 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-203f7714-6cab-44b8-a355-926729be13ed tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:33.459241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-65a3e061-9142-4991-890e-9b8532f36607 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:33.459457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-203f7714-6cab-44b8-a355-926729be13ed tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:33.460273 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-65a3e061-9142-4991-890e-9b8532f36607 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:33.461090 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-65a3e061-9142-4991-890e-9b8532f36607 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:33.663954 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-203f7714-6cab-44b8-a355-926729be13ed tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:33.670158 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-65a3e061-9142-4991-890e-9b8532f36607 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:33.673999 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-203f7714-6cab-44b8-a355-926729be13ed tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1359 microversion: 2.1 time: 0.229481 Jun 17 08:54:33.684117 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 192/396] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:33 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:33.684117 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1de56dd5-e229-465d-ab0b-2a72cf95464b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:33.684117 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-1de56dd5-e229-465d-ab0b-2a72cf95464b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:33.687749 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1de56dd5-e229-465d-ab0b-2a72cf95464b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:33.688212 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1de56dd5-e229-465d-ab0b-2a72cf95464b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:33.689050 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1de56dd5-e229-465d-ab0b-2a72cf95464b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:33.689710 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1de56dd5-e229-465d-ab0b-2a72cf95464b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:33.690870 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-65a3e061-9142-4991-890e-9b8532f36607 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:33.694214 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-65a3e061-9142-4991-890e-9b8532f36607 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:33.696777 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-65a3e061-9142-4991-890e-9b8532f36607 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1722 microversion: 2.20 time: 0.252590 Jun 17 08:54:33.697806 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 205/397] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:33 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:33.793151 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-9f6e1753-c28c-4c38-b1a5-44d666d9e630 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:33.793755 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-9f6e1753-c28c-4c38-b1a5-44d666d9e630 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:33.800101 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9f6e1753-c28c-4c38-b1a5-44d666d9e630 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:33.800555 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9f6e1753-c28c-4c38-b1a5-44d666d9e630 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:33.801345 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9f6e1753-c28c-4c38-b1a5-44d666d9e630 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:33.801789 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9f6e1753-c28c-4c38-b1a5-44d666d9e630 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:33.842146 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-1de56dd5-e229-465d-ab0b-2a72cf95464b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:33.852290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-1de56dd5-e229-465d-ab0b-2a72cf95464b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.175308 Jun 17 08:54:33.852290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 193/398] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:33 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:33.924348 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-ea3fb486-0121-4ca5-8ad4-43021f66ff39 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:33.925867 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-ea3fb486-0121-4ca5-8ad4-43021f66ff39 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:33.931271 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ea3fb486-0121-4ca5-8ad4-43021f66ff39 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:33.931754 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ea3fb486-0121-4ca5-8ad4-43021f66ff39 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:33.932578 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ea3fb486-0121-4ca5-8ad4-43021f66ff39 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:33.932970 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ea3fb486-0121-4ca5-8ad4-43021f66ff39 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:33.947316 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-9f6e1753-c28c-4c38-b1a5-44d666d9e630 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:33.955889 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-9f6e1753-c28c-4c38-b1a5-44d666d9e630 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.166309 Jun 17 08:54:33.955889 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 206/399] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:33 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:34.081144 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-ea3fb486-0121-4ca5-8ad4-43021f66ff39 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:34.088615 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-ea3fb486-0121-4ca5-8ad4-43021f66ff39 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1471 microversion: 2.1 time: 0.168411 Jun 17 08:54:34.089190 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 194/400] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:33 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1471 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:34.152271 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-465e8f16-3c25-4883-893c-7c87f199fa1d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:34.152883 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-465e8f16-3c25-4883-893c-7c87f199fa1d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:34.159117 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-465e8f16-3c25-4883-893c-7c87f199fa1d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:34.159605 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-465e8f16-3c25-4883-893c-7c87f199fa1d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:34.160365 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-465e8f16-3c25-4883-893c-7c87f199fa1d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:34.160800 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-465e8f16-3c25-4883-893c-7c87f199fa1d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:34.302330 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-465e8f16-3c25-4883-893c-7c87f199fa1d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:34.310970 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-465e8f16-3c25-4883-893c-7c87f199fa1d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.162765 Jun 17 08:54:34.311674 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 207/401] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:34 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:34.691369 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-4d27c037-0302-4f2d-94ff-19fce7cc2e04 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:34.692043 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-4d27c037-0302-4f2d-94ff-19fce7cc2e04 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:34.698254 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4d27c037-0302-4f2d-94ff-19fce7cc2e04 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:34.698706 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4d27c037-0302-4f2d-94ff-19fce7cc2e04 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:34.699503 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4d27c037-0302-4f2d-94ff-19fce7cc2e04 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:34.699943 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4d27c037-0302-4f2d-94ff-19fce7cc2e04 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:34.715387 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-fe4379cb-f53a-4596-b3a8-d816d24ff666 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:34.715995 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-fe4379cb-f53a-4596-b3a8-d816d24ff666 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:34.723491 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fe4379cb-f53a-4596-b3a8-d816d24ff666 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:34.723950 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fe4379cb-f53a-4596-b3a8-d816d24ff666 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:34.724726 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fe4379cb-f53a-4596-b3a8-d816d24ff666 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:34.725161 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fe4379cb-f53a-4596-b3a8-d816d24ff666 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:35.052309 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-4d27c037-0302-4f2d-94ff-19fce7cc2e04 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:35.063236 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-4d27c037-0302-4f2d-94ff-19fce7cc2e04 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1359 microversion: 2.1 time: 0.375661 Jun 17 08:54:35.073327 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 195/402] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:34 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1359 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:35.078469 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-10b33f0d-2913-41e5-b94d-50be02e58162 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:35.079851 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-10b33f0d-2913-41e5-b94d-50be02e58162 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:35.088641 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-10b33f0d-2913-41e5-b94d-50be02e58162 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:35.089391 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-10b33f0d-2913-41e5-b94d-50be02e58162 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:35.090373 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-10b33f0d-2913-41e5-b94d-50be02e58162 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:35.091541 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-10b33f0d-2913-41e5-b94d-50be02e58162 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:35.098009 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-fe4379cb-f53a-4596-b3a8-d816d24ff666 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:35.109465 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-fe4379cb-f53a-4596-b3a8-d816d24ff666 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:35.115707 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-fe4379cb-f53a-4596-b3a8-d816d24ff666 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:35.115707 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-fe4379cb-f53a-4596-b3a8-d816d24ff666 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1722 microversion: 2.20 time: 0.401205 Jun 17 08:54:35.115707 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 208/403] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:34 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1722 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:35.135490 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-ed7a5d6c-a5b9-4ab1-8004-b6f05d01f58f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:35.136123 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-ed7a5d6c-a5b9-4ab1-8004-b6f05d01f58f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:35.145288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ed7a5d6c-a5b9-4ab1-8004-b6f05d01f58f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:35.149165 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ed7a5d6c-a5b9-4ab1-8004-b6f05d01f58f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:35.149165 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ed7a5d6c-a5b9-4ab1-8004-b6f05d01f58f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:35.149165 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ed7a5d6c-a5b9-4ab1-8004-b6f05d01f58f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:35.308170 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-10b33f0d-2913-41e5-b94d-50be02e58162 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:35.316399 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-10b33f0d-2913-41e5-b94d-50be02e58162 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.241604 Jun 17 08:54:35.317288 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 196/404] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:35 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:35.322373 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-18b34e9f-b6dd-4250-81b2-c0abcfc0bf51 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:35.323628 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-18b34e9f-b6dd-4250-81b2-c0abcfc0bf51 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:35.329687 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-18b34e9f-b6dd-4250-81b2-c0abcfc0bf51 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:35.330312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-18b34e9f-b6dd-4250-81b2-c0abcfc0bf51 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:35.331093 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-18b34e9f-b6dd-4250-81b2-c0abcfc0bf51 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:35.331586 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-18b34e9f-b6dd-4250-81b2-c0abcfc0bf51 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:35.332339 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-ed7a5d6c-a5b9-4ab1-8004-b6f05d01f58f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:35.348493 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-ed7a5d6c-a5b9-4ab1-8004-b6f05d01f58f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.210950 Jun 17 08:54:35.348493 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 209/405] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:35 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:35.348493 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-05d80421-5e5c-43ba-86f5-524a62bf6341 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:35.348493 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-05d80421-5e5c-43ba-86f5-524a62bf6341 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:35.355009 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-05d80421-5e5c-43ba-86f5-524a62bf6341 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:35.356086 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-05d80421-5e5c-43ba-86f5-524a62bf6341 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:35.356891 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-05d80421-5e5c-43ba-86f5-524a62bf6341 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:35.357024 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-05d80421-5e5c-43ba-86f5-524a62bf6341 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:35.558524 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-18b34e9f-b6dd-4250-81b2-c0abcfc0bf51 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:35.563066 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-05d80421-5e5c-43ba-86f5-524a62bf6341 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:35.566371 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-18b34e9f-b6dd-4250-81b2-c0abcfc0bf51 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1471 microversion: 2.1 time: 0.248228 Jun 17 08:54:35.569272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 197/406] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:35 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1471 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:35.571484 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-05d80421-5e5c-43ba-86f5-524a62bf6341 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.228120 Jun 17 08:54:35.572055 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 210/407] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:35 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:36.082214 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-e84f9481-d0a8-45b8-bf42-02af68831ec4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:36.083613 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-e84f9481-d0a8-45b8-bf42-02af68831ec4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:36.099654 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e84f9481-d0a8-45b8-bf42-02af68831ec4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:36.102556 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e84f9481-d0a8-45b8-bf42-02af68831ec4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:36.103322 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e84f9481-d0a8-45b8-bf42-02af68831ec4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:36.103817 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e84f9481-d0a8-45b8-bf42-02af68831ec4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:36.135283 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-791fd644-a880-4238-be4a-3ed477fb4117 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:36.144887 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-791fd644-a880-4238-be4a-3ed477fb4117 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:36.168778 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-791fd644-a880-4238-be4a-3ed477fb4117 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:36.169237 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-791fd644-a880-4238-be4a-3ed477fb4117 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:36.174021 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-791fd644-a880-4238-be4a-3ed477fb4117 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:36.174493 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-791fd644-a880-4238-be4a-3ed477fb4117 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:36.460775 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-e84f9481-d0a8-45b8-bf42-02af68831ec4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:36.469501 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-e84f9481-d0a8-45b8-bf42-02af68831ec4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1359 microversion: 2.1 time: 0.392669 Jun 17 08:54:36.470329 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 198/408] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:36 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1359 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:36.480497 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-8134620b-b54e-4d0c-b68e-4766dbba78e6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:36.480997 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-791fd644-a880-4238-be4a-3ed477fb4117 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:36.481911 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-8134620b-b54e-4d0c-b68e-4766dbba78e6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:36.488278 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8134620b-b54e-4d0c-b68e-4766dbba78e6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:36.488739 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8134620b-b54e-4d0c-b68e-4766dbba78e6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:36.489559 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8134620b-b54e-4d0c-b68e-4766dbba78e6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:36.489947 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8134620b-b54e-4d0c-b68e-4766dbba78e6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:36.491869 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-791fd644-a880-4238-be4a-3ed477fb4117 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:36.493809 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-791fd644-a880-4238-be4a-3ed477fb4117 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:36.495305 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-791fd644-a880-4238-be4a-3ed477fb4117 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1722 microversion: 2.20 time: 0.366571 Jun 17 08:54:36.508961 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 211/409] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:36 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1722 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:36.514003 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-89f78703-b61f-43ab-8da8-b807642ac31d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:36.517639 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-89f78703-b61f-43ab-8da8-b807642ac31d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:36.521577 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-89f78703-b61f-43ab-8da8-b807642ac31d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:36.522213 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-89f78703-b61f-43ab-8da8-b807642ac31d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:36.523821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-89f78703-b61f-43ab-8da8-b807642ac31d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:36.524430 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-89f78703-b61f-43ab-8da8-b807642ac31d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:36.937658 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-8134620b-b54e-4d0c-b68e-4766dbba78e6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:36.950445 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-8134620b-b54e-4d0c-b68e-4766dbba78e6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.478366 Jun 17 08:54:36.961662 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-89f78703-b61f-43ab-8da8-b807642ac31d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:36.964094 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 199/410] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:36 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:36.970429 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-89f78703-b61f-43ab-8da8-b807642ac31d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.460196 Jun 17 08:54:36.981225 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-12d30c1b-f2a3-4fcd-83e5-d20772737cc6 req-0c1edd76-07de-4c53-8cbe-f66a76f35dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d", "name": "network-vif-plugged", "status": "completed", "tag": "865d7ab5-9d19-42eb-8363-e2eb81b9295c"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:54:36.981424 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 212/411] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:36 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:36.981424 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-f8a225e3-0411-4e86-9900-56f0b2a81f00 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:36.981424 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-f8a225e3-0411-4e86-9900-56f0b2a81f00 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:36.986410 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f8a225e3-0411-4e86-9900-56f0b2a81f00 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:36.987070 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f8a225e3-0411-4e86-9900-56f0b2a81f00 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:36.988014 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f8a225e3-0411-4e86-9900-56f0b2a81f00 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:36.988742 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f8a225e3-0411-4e86-9900-56f0b2a81f00 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:36.993797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-12d30c1b-f2a3-4fcd-83e5-d20772737cc6 req-0c1edd76-07de-4c53-8cbe-f66a76f35dd1 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:36.994392 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-12d30c1b-f2a3-4fcd-83e5-d20772737cc6 req-0c1edd76-07de-4c53-8cbe-f66a76f35dd1 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:37.010972 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-12d30c1b-f2a3-4fcd-83e5-d20772737cc6 req-0c1edd76-07de-4c53-8cbe-f66a76f35dd1 service nova] Creating event network-vif-plugged:865d7ab5-9d19-42eb-8363-e2eb81b9295c for instance 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d on hv-cinder-79760 Jun 17 08:54:37.017671 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-12d30c1b-f2a3-4fcd-83e5-d20772737cc6 req-0c1edd76-07de-4c53-8cbe-f66a76f35dd1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051296 Jun 17 08:54:37.018576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 200/412] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:54:37.027734 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-faaa6915-8fd0-47ef-abab-cd42ce695bfc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:37.048002 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-faaa6915-8fd0-47ef-abab-cd42ce695bfc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:37.078986 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-faaa6915-8fd0-47ef-abab-cd42ce695bfc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:37.078986 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-faaa6915-8fd0-47ef-abab-cd42ce695bfc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:37.078986 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-faaa6915-8fd0-47ef-abab-cd42ce695bfc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:37.078986 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-faaa6915-8fd0-47ef-abab-cd42ce695bfc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:37.342891 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-faaa6915-8fd0-47ef-abab-cd42ce695bfc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:37.350567 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-faaa6915-8fd0-47ef-abab-cd42ce695bfc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.329971 Jun 17 08:54:37.360614 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 201/413] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:37 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:37.369704 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-f8a225e3-0411-4e86-9900-56f0b2a81f00 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:37.382149 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-f8a225e3-0411-4e86-9900-56f0b2a81f00 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1471 microversion: 2.1 time: 0.409814 Jun 17 08:54:37.389636 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 213/414] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:36 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1471 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:37.422124 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-9fc3a3eb-6306-4112-a680-08b78c581437 req-d16c44ec-5ae6-4be8-b1b3-1bf3f40f9a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c5d606-fea9-467c-a074-2a9a1030a461", "name": "network-vif-deleted", "tag": "becbd5f3-c900-4dec-a28c-cf23062ef2fb"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:54:37.436470 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-9fc3a3eb-6306-4112-a680-08b78c581437 req-d16c44ec-5ae6-4be8-b1b3-1bf3f40f9a91 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:37.436470 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-9fc3a3eb-6306-4112-a680-08b78c581437 req-d16c44ec-5ae6-4be8-b1b3-1bf3f40f9a91 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:37.446144 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-9fc3a3eb-6306-4112-a680-08b78c581437 req-d16c44ec-5ae6-4be8-b1b3-1bf3f40f9a91 service nova] Creating event network-vif-deleted:becbd5f3-c900-4dec-a28c-cf23062ef2fb for instance 30c5d606-fea9-467c-a074-2a9a1030a461 on hv-cinder-79760 Jun 17 08:54:37.451717 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-9fc3a3eb-6306-4112-a680-08b78c581437 req-d16c44ec-5ae6-4be8-b1b3-1bf3f40f9a91 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033633 Jun 17 08:54:37.452667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 202/415] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:54:37.495200 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-dab32c6e-994d-4db1-9c92-60cd21e3dab9 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:37.496047 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-dab32c6e-994d-4db1-9c92-60cd21e3dab9 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:37.507028 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dab32c6e-994d-4db1-9c92-60cd21e3dab9 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:37.508411 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dab32c6e-994d-4db1-9c92-60cd21e3dab9 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:37.508869 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dab32c6e-994d-4db1-9c92-60cd21e3dab9 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:37.509471 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dab32c6e-994d-4db1-9c92-60cd21e3dab9 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:37.520959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-27302387-95fd-482f-9036-4e470f97c6c5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:37.523863 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-27302387-95fd-482f-9036-4e470f97c6c5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:37.531662 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-27302387-95fd-482f-9036-4e470f97c6c5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:37.533683 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-27302387-95fd-482f-9036-4e470f97c6c5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:37.533810 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-27302387-95fd-482f-9036-4e470f97c6c5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:37.534756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-27302387-95fd-482f-9036-4e470f97c6c5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:37.719285 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-dab32c6e-994d-4db1-9c92-60cd21e3dab9 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:37.727711 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-dab32c6e-994d-4db1-9c92-60cd21e3dab9 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1359 microversion: 2.1 time: 0.237469 Jun 17 08:54:37.728290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 214/416] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:37 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:37.731526 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-27302387-95fd-482f-9036-4e470f97c6c5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:37.739497 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-27302387-95fd-482f-9036-4e470f97c6c5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:37.741004 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-27302387-95fd-482f-9036-4e470f97c6c5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:37.743291 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-27302387-95fd-482f-9036-4e470f97c6c5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1722 microversion: 2.20 time: 0.230476 Jun 17 08:54:37.743704 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 203/417] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:37 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:54:37.820153 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-4ab27173-4b92-4638-bfc0-3083d1877a0f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:37.820645 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-4ab27173-4b92-4638-bfc0-3083d1877a0f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:37.826550 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4ab27173-4b92-4638-bfc0-3083d1877a0f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:37.826994 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4ab27173-4b92-4638-bfc0-3083d1877a0f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:37.827789 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4ab27173-4b92-4638-bfc0-3083d1877a0f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:37.828223 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4ab27173-4b92-4638-bfc0-3083d1877a0f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:37.853410 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-4ab27173-4b92-4638-bfc0-3083d1877a0f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Going to try to terminate instance {{(pid=129876) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:54:37.970498 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-01edf1ba-7851-4dcb-8577-4a11c98cdfca tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:37.971016 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-01edf1ba-7851-4dcb-8577-4a11c98cdfca tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:37.977798 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-01edf1ba-7851-4dcb-8577-4a11c98cdfca tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:37.978236 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-01edf1ba-7851-4dcb-8577-4a11c98cdfca tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:37.978991 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-01edf1ba-7851-4dcb-8577-4a11c98cdfca tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:37.979462 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-01edf1ba-7851-4dcb-8577-4a11c98cdfca tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:38.109856 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-01edf1ba-7851-4dcb-8577-4a11c98cdfca tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:38.117535 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-01edf1ba-7851-4dcb-8577-4a11c98cdfca tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.151008 Jun 17 08:54:38.118102 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 204/418] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:37 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:38.122630 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-87ad6c05-f4a4-4349-b2dc-edc3809767f7 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:38.123239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-87ad6c05-f4a4-4349-b2dc-edc3809767f7 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:38.129172 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-87ad6c05-f4a4-4349-b2dc-edc3809767f7 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:38.129619 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-87ad6c05-f4a4-4349-b2dc-edc3809767f7 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:38.130377 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-87ad6c05-f4a4-4349-b2dc-edc3809767f7 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:38.130813 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-87ad6c05-f4a4-4349-b2dc-edc3809767f7 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:38.209788 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-4ab27173-4b92-4638-bfc0-3083d1877a0f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "DELETE /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 204 len: 0 microversion: 2.1 time: 0.392705 Jun 17 08:54:38.211254 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 215/419] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 08:54:37 2022] DELETE /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:54:38.219846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-77fa4aa1-4f5e-4c2b-95d7-efeea26c4548 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:38.222687 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-77fa4aa1-4f5e-4c2b-95d7-efeea26c4548 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:38.227035 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-77fa4aa1-4f5e-4c2b-95d7-efeea26c4548 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:38.227609 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-77fa4aa1-4f5e-4c2b-95d7-efeea26c4548 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:38.228384 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-77fa4aa1-4f5e-4c2b-95d7-efeea26c4548 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:38.228829 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-77fa4aa1-4f5e-4c2b-95d7-efeea26c4548 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:38.281729 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-87ad6c05-f4a4-4349-b2dc-edc3809767f7 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:38.289171 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-87ad6c05-f4a4-4349-b2dc-edc3809767f7 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.170095 Jun 17 08:54:38.289761 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 205/420] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:38 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:38.372206 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-b5205ca2-7aad-4376-8db3-d5808a1373ce tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:38.372206 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-b5205ca2-7aad-4376-8db3-d5808a1373ce tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:38.374146 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-77fa4aa1-4f5e-4c2b-95d7-efeea26c4548 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:38.378235 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b5205ca2-7aad-4376-8db3-d5808a1373ce tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:38.378683 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b5205ca2-7aad-4376-8db3-d5808a1373ce tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:38.379478 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b5205ca2-7aad-4376-8db3-d5808a1373ce tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:38.379914 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b5205ca2-7aad-4376-8db3-d5808a1373ce tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:38.381698 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-77fa4aa1-4f5e-4c2b-95d7-efeea26c4548 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1512 microversion: 2.1 time: 0.165935 Jun 17 08:54:38.383004 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 216/421] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:38 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:38.404650 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-000cf911-b0f9-4916-816d-1f4f09a187a8 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:38.405285 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-000cf911-b0f9-4916-816d-1f4f09a187a8 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:38.411830 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-000cf911-b0f9-4916-816d-1f4f09a187a8 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:38.412292 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-000cf911-b0f9-4916-816d-1f4f09a187a8 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:38.413080 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-000cf911-b0f9-4916-816d-1f4f09a187a8 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:38.413601 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-000cf911-b0f9-4916-816d-1f4f09a187a8 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:38.486404 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-000cf911-b0f9-4916-816d-1f4f09a187a8 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:38.494439 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-000cf911-b0f9-4916-816d-1f4f09a187a8 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1300 microversion: 2.1 time: 0.093718 Jun 17 08:54:38.495015 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 217/422] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:38 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:38.545059 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b5205ca2-7aad-4376-8db3-d5808a1373ce tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:38.552851 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-b5205ca2-7aad-4376-8db3-d5808a1373ce tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.185104 Jun 17 08:54:38.553460 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 206/423] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:38 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:38.745435 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-451e7a80-1a2d-47ea-9159-4476d460d11d tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:38.746164 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-451e7a80-1a2d-47ea-9159-4476d460d11d tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:38.752879 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-451e7a80-1a2d-47ea-9159-4476d460d11d tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:38.753315 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-451e7a80-1a2d-47ea-9159-4476d460d11d tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:38.754108 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-451e7a80-1a2d-47ea-9159-4476d460d11d tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:38.754543 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-451e7a80-1a2d-47ea-9159-4476d460d11d tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:38.763239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-80cfec21-47bd-435e-b844-89f12dbf43ae tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:38.763896 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-80cfec21-47bd-435e-b844-89f12dbf43ae tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:38.770419 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-80cfec21-47bd-435e-b844-89f12dbf43ae tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:38.770865 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-80cfec21-47bd-435e-b844-89f12dbf43ae tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:38.771702 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-80cfec21-47bd-435e-b844-89f12dbf43ae tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:38.771969 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:38.772145 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-80cfec21-47bd-435e-b844-89f12dbf43ae tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:38.967321 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-451e7a80-1a2d-47ea-9159-4476d460d11d tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:38.974280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-80cfec21-47bd-435e-b844-89f12dbf43ae tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:38.975249 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-451e7a80-1a2d-47ea-9159-4476d460d11d tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1359 microversion: 2.1 time: 0.234379 Jun 17 08:54:38.976422 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 218/424] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:38 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1359 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:38.983597 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-80cfec21-47bd-435e-b844-89f12dbf43ae tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:38.985097 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-80cfec21-47bd-435e-b844-89f12dbf43ae tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:38.986259 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-80cfec21-47bd-435e-b844-89f12dbf43ae tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1722 microversion: 2.20 time: 0.227672 Jun 17 08:54:38.986812 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 207/425] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:38 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:39.134350 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-3b0f1795-742f-4a2c-b44f-e6279fe950aa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:39.134885 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-3b0f1795-742f-4a2c-b44f-e6279fe950aa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:39.141127 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3b0f1795-742f-4a2c-b44f-e6279fe950aa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:39.141574 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3b0f1795-742f-4a2c-b44f-e6279fe950aa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:39.142345 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3b0f1795-742f-4a2c-b44f-e6279fe950aa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:39.142780 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3b0f1795-742f-4a2c-b44f-e6279fe950aa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:39.269604 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-3b0f1795-742f-4a2c-b44f-e6279fe950aa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:39.277743 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-3b0f1795-742f-4a2c-b44f-e6279fe950aa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.147604 Jun 17 08:54:39.278318 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 219/426] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:39 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:39.310162 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-72b78b1f-90df-4321-8484-4e1df4545129 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:39.310774 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-72b78b1f-90df-4321-8484-4e1df4545129 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:39.317385 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-72b78b1f-90df-4321-8484-4e1df4545129 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:39.317839 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-72b78b1f-90df-4321-8484-4e1df4545129 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:39.318601 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-72b78b1f-90df-4321-8484-4e1df4545129 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:39.319042 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-72b78b1f-90df-4321-8484-4e1df4545129 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:39.400969 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-08fffc1d-99e8-4b3a-9a74-47e9bbfcee4a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:39.401664 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-08fffc1d-99e8-4b3a-9a74-47e9bbfcee4a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:39.407936 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-08fffc1d-99e8-4b3a-9a74-47e9bbfcee4a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:39.408394 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-08fffc1d-99e8-4b3a-9a74-47e9bbfcee4a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:39.409205 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-08fffc1d-99e8-4b3a-9a74-47e9bbfcee4a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:39.409650 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-08fffc1d-99e8-4b3a-9a74-47e9bbfcee4a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:39.715167 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-72b78b1f-90df-4321-8484-4e1df4545129 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:39.722572 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-72b78b1f-90df-4321-8484-4e1df4545129 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.416495 Jun 17 08:54:39.723543 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 208/427] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:39 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:39.728470 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-badde28d-344b-44f9-8bd1-50b7a50d2ed2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:39.729082 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-badde28d-344b-44f9-8bd1-50b7a50d2ed2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:39.735076 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-badde28d-344b-44f9-8bd1-50b7a50d2ed2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:39.735572 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-badde28d-344b-44f9-8bd1-50b7a50d2ed2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:39.736351 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-badde28d-344b-44f9-8bd1-50b7a50d2ed2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:39.736791 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-badde28d-344b-44f9-8bd1-50b7a50d2ed2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:39.755971 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=100 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:39.793511 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-08fffc1d-99e8-4b3a-9a74-47e9bbfcee4a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:39.801198 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-08fffc1d-99e8-4b3a-9a74-47e9bbfcee4a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1512 microversion: 2.1 time: 0.405139 Jun 17 08:54:39.801770 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 220/428] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:39 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1512 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:39.807722 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-9144cd33-a638-4cc9-881d-bf3d4a7102d2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:39.808341 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-9144cd33-a638-4cc9-881d-bf3d4a7102d2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:39.810525 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-badde28d-344b-44f9-8bd1-50b7a50d2ed2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:39.814865 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9144cd33-a638-4cc9-881d-bf3d4a7102d2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:39.815324 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9144cd33-a638-4cc9-881d-bf3d4a7102d2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:39.816125 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9144cd33-a638-4cc9-881d-bf3d4a7102d2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:39.816574 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9144cd33-a638-4cc9-881d-bf3d4a7102d2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:39.818190 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-badde28d-344b-44f9-8bd1-50b7a50d2ed2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1300 microversion: 2.1 time: 0.094021 Jun 17 08:54:39.818776 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 209/429] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:39 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:39.949601 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-9144cd33-a638-4cc9-881d-bf3d4a7102d2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:39.956985 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-9144cd33-a638-4cc9-881d-bf3d4a7102d2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.153963 Jun 17 08:54:39.957547 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 221/430] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:39 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:39.993607 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-787dc9f2-94b8-4d93-9a49-725cdc1d9c51 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:39.994221 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-787dc9f2-94b8-4d93-9a49-725cdc1d9c51 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:40.000541 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-787dc9f2-94b8-4d93-9a49-725cdc1d9c51 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:40.000985 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-787dc9f2-94b8-4d93-9a49-725cdc1d9c51 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:40.001751 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-787dc9f2-94b8-4d93-9a49-725cdc1d9c51 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:40.002179 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-787dc9f2-94b8-4d93-9a49-725cdc1d9c51 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:40.004562 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-ab0421bc-92b3-4aba-8be9-864fd53a9d11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:40.005177 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-ab0421bc-92b3-4aba-8be9-864fd53a9d11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:40.011548 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ab0421bc-92b3-4aba-8be9-864fd53a9d11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:40.012007 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ab0421bc-92b3-4aba-8be9-864fd53a9d11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:40.012784 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ab0421bc-92b3-4aba-8be9-864fd53a9d11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:40.013252 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ab0421bc-92b3-4aba-8be9-864fd53a9d11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:40.208959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-787dc9f2-94b8-4d93-9a49-725cdc1d9c51 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:40.213459 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-ab0421bc-92b3-4aba-8be9-864fd53a9d11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:40.217500 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-787dc9f2-94b8-4d93-9a49-725cdc1d9c51 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1359 microversion: 2.1 time: 0.228398 Jun 17 08:54:40.219207 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 210/431] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:39 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:40.221570 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-ab0421bc-92b3-4aba-8be9-864fd53a9d11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:40.223059 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-ab0421bc-92b3-4aba-8be9-864fd53a9d11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:40.224236 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-ab0421bc-92b3-4aba-8be9-864fd53a9d11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1722 microversion: 2.20 time: 0.223542 Jun 17 08:54:40.224782 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 222/432] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:39 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:54:40.295258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1fb415da-0fcf-46dc-b7bf-e2eec7319647 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:40.295815 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-1fb415da-0fcf-46dc-b7bf-e2eec7319647 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:40.301739 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1fb415da-0fcf-46dc-b7bf-e2eec7319647 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:40.302187 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1fb415da-0fcf-46dc-b7bf-e2eec7319647 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:40.302947 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1fb415da-0fcf-46dc-b7bf-e2eec7319647 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:40.303411 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1fb415da-0fcf-46dc-b7bf-e2eec7319647 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:40.436882 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-1fb415da-0fcf-46dc-b7bf-e2eec7319647 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:40.445324 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-1fb415da-0fcf-46dc-b7bf-e2eec7319647 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.153182 Jun 17 08:54:40.446311 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 211/433] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:40 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:40.741515 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-1eece991-ecad-46f2-9388-a50951f2cdcc tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:40.743445 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-1eece991-ecad-46f2-9388-a50951f2cdcc tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:40.749587 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1eece991-ecad-46f2-9388-a50951f2cdcc tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:40.749998 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1eece991-ecad-46f2-9388-a50951f2cdcc tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:40.750774 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1eece991-ecad-46f2-9388-a50951f2cdcc tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:40.751219 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1eece991-ecad-46f2-9388-a50951f2cdcc tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:40.819269 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-17373d39-c682-45fb-a7bb-b628397c7c32 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:40.820855 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-17373d39-c682-45fb-a7bb-b628397c7c32 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:40.827601 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-17373d39-c682-45fb-a7bb-b628397c7c32 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:40.828843 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-17373d39-c682-45fb-a7bb-b628397c7c32 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:40.829809 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-17373d39-c682-45fb-a7bb-b628397c7c32 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:40.830441 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-17373d39-c682-45fb-a7bb-b628397c7c32 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:40.954718 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-1eece991-ecad-46f2-9388-a50951f2cdcc tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:40.963812 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-1eece991-ecad-46f2-9388-a50951f2cdcc tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.227806 Jun 17 08:54:40.964400 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 223/434] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:40 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:40.968931 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-448f8874-b9d2-4ada-81f8-fb2ae9c7c1e7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:40.969573 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-448f8874-b9d2-4ada-81f8-fb2ae9c7c1e7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:40.976433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-448f8874-b9d2-4ada-81f8-fb2ae9c7c1e7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:40.977269 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-448f8874-b9d2-4ada-81f8-fb2ae9c7c1e7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:40.977851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-448f8874-b9d2-4ada-81f8-fb2ae9c7c1e7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:40.978289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-448f8874-b9d2-4ada-81f8-fb2ae9c7c1e7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:41.004994 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-17373d39-c682-45fb-a7bb-b628397c7c32 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:41.013982 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-17373d39-c682-45fb-a7bb-b628397c7c32 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1512 microversion: 2.1 time: 0.198636 Jun 17 08:54:41.015042 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 212/435] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:40 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1512 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:41.019993 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-cfd34264-78c2-4f04-8d8d-47228d581357 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:41.020712 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-cfd34264-78c2-4f04-8d8d-47228d581357 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:41.028352 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-cfd34264-78c2-4f04-8d8d-47228d581357 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:41.028895 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-cfd34264-78c2-4f04-8d8d-47228d581357 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:41.029765 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-cfd34264-78c2-4f04-8d8d-47228d581357 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:41.030209 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-cfd34264-78c2-4f04-8d8d-47228d581357 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:41.043508 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-448f8874-b9d2-4ada-81f8-fb2ae9c7c1e7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:41.051220 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-448f8874-b9d2-4ada-81f8-fb2ae9c7c1e7 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1300 microversion: 2.1 time: 0.085800 Jun 17 08:54:41.051840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 224/436] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:40 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1300 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:41.168719 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-cfd34264-78c2-4f04-8d8d-47228d581357 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:41.176552 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-cfd34264-78c2-4f04-8d8d-47228d581357 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.160394 Jun 17 08:54:41.177380 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 213/437] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:41 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:41.235883 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-959c2fdb-0619-463a-b156-72d97e966640 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:41.236578 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-959c2fdb-0619-463a-b156-72d97e966640 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:41.241859 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-f00e9b85-a112-4504-b87f-cfd25e453b78 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:41.242570 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-f00e9b85-a112-4504-b87f-cfd25e453b78 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:41.242733 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-959c2fdb-0619-463a-b156-72d97e966640 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:41.243189 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-959c2fdb-0619-463a-b156-72d97e966640 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:41.243983 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-959c2fdb-0619-463a-b156-72d97e966640 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:41.244423 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-959c2fdb-0619-463a-b156-72d97e966640 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:41.249042 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f00e9b85-a112-4504-b87f-cfd25e453b78 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:41.253450 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f00e9b85-a112-4504-b87f-cfd25e453b78 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:41.253450 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f00e9b85-a112-4504-b87f-cfd25e453b78 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:41.253450 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f00e9b85-a112-4504-b87f-cfd25e453b78 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:41.444519 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f00e9b85-a112-4504-b87f-cfd25e453b78 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:41.448327 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-959c2fdb-0619-463a-b156-72d97e966640 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:41.453850 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f00e9b85-a112-4504-b87f-cfd25e453b78 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:41.455374 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f00e9b85-a112-4504-b87f-cfd25e453b78 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:41.456336 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-959c2fdb-0619-463a-b156-72d97e966640 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1359 microversion: 2.1 time: 0.224255 Jun 17 08:54:41.457102 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 225/438] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:41 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:41.458823 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-f00e9b85-a112-4504-b87f-cfd25e453b78 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1722 microversion: 2.20 time: 0.220364 Jun 17 08:54:41.469361 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 214/439] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:41 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:54:41.469548 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-b4d2c3a5-afbb-4aa5-9be5-f86aba4b1f65 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:41.469548 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-b4d2c3a5-afbb-4aa5-9be5-f86aba4b1f65 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:41.469548 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b4d2c3a5-afbb-4aa5-9be5-f86aba4b1f65 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:41.469845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b4d2c3a5-afbb-4aa5-9be5-f86aba4b1f65 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:41.470366 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b4d2c3a5-afbb-4aa5-9be5-f86aba4b1f65 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:41.470807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b4d2c3a5-afbb-4aa5-9be5-f86aba4b1f65 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:41.610797 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-b4d2c3a5-afbb-4aa5-9be5-f86aba4b1f65 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:41.620315 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-b4d2c3a5-afbb-4aa5-9be5-f86aba4b1f65 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.162158 Jun 17 08:54:41.624144 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 226/440] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:41 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:41.981583 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-f77d26ec-fe53-4161-96ad-fe2032479eb6 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:41.982172 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-f77d26ec-fe53-4161-96ad-fe2032479eb6 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:41.988256 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f77d26ec-fe53-4161-96ad-fe2032479eb6 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:41.988700 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f77d26ec-fe53-4161-96ad-fe2032479eb6 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:41.989497 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f77d26ec-fe53-4161-96ad-fe2032479eb6 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:41.989930 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f77d26ec-fe53-4161-96ad-fe2032479eb6 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:42.031904 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-257f0327-77a2-4483-bb0a-2e1179bafcd3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:42.032436 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-257f0327-77a2-4483-bb0a-2e1179bafcd3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:42.039941 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-257f0327-77a2-4483-bb0a-2e1179bafcd3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:42.040402 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-257f0327-77a2-4483-bb0a-2e1179bafcd3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:42.041188 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-257f0327-77a2-4483-bb0a-2e1179bafcd3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:42.041618 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-257f0327-77a2-4483-bb0a-2e1179bafcd3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:42.178259 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f77d26ec-fe53-4161-96ad-fe2032479eb6 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:42.186734 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-f77d26ec-fe53-4161-96ad-fe2032479eb6 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.209219 Jun 17 08:54:42.187304 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 215/441] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:41 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:42.195658 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-f0320599-b929-4690-b280-84b0c56b1017 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:42.195658 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-f0320599-b929-4690-b280-84b0c56b1017 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:42.198645 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f0320599-b929-4690-b280-84b0c56b1017 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:42.199096 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f0320599-b929-4690-b280-84b0c56b1017 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:42.199918 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f0320599-b929-4690-b280-84b0c56b1017 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:42.200363 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f0320599-b929-4690-b280-84b0c56b1017 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:42.217274 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-257f0327-77a2-4483-bb0a-2e1179bafcd3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:42.224930 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-257f0327-77a2-4483-bb0a-2e1179bafcd3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1512 microversion: 2.1 time: 0.197039 Jun 17 08:54:42.225503 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 227/442] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:42 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1512 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:42.230546 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-94d8e832-b0df-4aab-8f7c-3bbfc3de3c47 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:42.231151 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-94d8e832-b0df-4aab-8f7c-3bbfc3de3c47 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:42.238067 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-94d8e832-b0df-4aab-8f7c-3bbfc3de3c47 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:42.238516 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-94d8e832-b0df-4aab-8f7c-3bbfc3de3c47 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:42.239275 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-94d8e832-b0df-4aab-8f7c-3bbfc3de3c47 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:42.239747 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-94d8e832-b0df-4aab-8f7c-3bbfc3de3c47 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:42.272187 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f0320599-b929-4690-b280-84b0c56b1017 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:42.280569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-f0320599-b929-4690-b280-84b0c56b1017 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1300 microversion: 2.1 time: 0.092245 Jun 17 08:54:42.281210 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 216/443] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:42 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:42.374572 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-94d8e832-b0df-4aab-8f7c-3bbfc3de3c47 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:42.382604 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-94d8e832-b0df-4aab-8f7c-3bbfc3de3c47 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.155488 Jun 17 08:54:42.383176 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 228/444] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:42 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:42.474161 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-698c5f5e-0d80-4e0d-91b7-15d701cd05a6 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:42.475258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-698c5f5e-0d80-4e0d-91b7-15d701cd05a6 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:42.477056 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-f8776afe-689d-4252-93ec-c9d7a8c2dd51 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:42.477775 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-f8776afe-689d-4252-93ec-c9d7a8c2dd51 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:42.483794 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-698c5f5e-0d80-4e0d-91b7-15d701cd05a6 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:42.484118 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f8776afe-689d-4252-93ec-c9d7a8c2dd51 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:42.484237 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-698c5f5e-0d80-4e0d-91b7-15d701cd05a6 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:42.484576 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f8776afe-689d-4252-93ec-c9d7a8c2dd51 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:42.484995 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-698c5f5e-0d80-4e0d-91b7-15d701cd05a6 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:42.485403 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f8776afe-689d-4252-93ec-c9d7a8c2dd51 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:42.485497 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-698c5f5e-0d80-4e0d-91b7-15d701cd05a6 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:42.485855 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f8776afe-689d-4252-93ec-c9d7a8c2dd51 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:42.682157 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-f8776afe-689d-4252-93ec-c9d7a8c2dd51 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:42.685237 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-698c5f5e-0d80-4e0d-91b7-15d701cd05a6 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:42.690891 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-f8776afe-689d-4252-93ec-c9d7a8c2dd51 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:42.692589 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-f8776afe-689d-4252-93ec-c9d7a8c2dd51 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:42.693057 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-698c5f5e-0d80-4e0d-91b7-15d701cd05a6 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1359 microversion: 2.1 time: 0.222840 Jun 17 08:54:42.693826 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 217/445] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:42 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:42.693953 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-f8776afe-689d-4252-93ec-c9d7a8c2dd51 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1722 microversion: 2.20 time: 0.221286 Jun 17 08:54:42.695236 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 229/446] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:42 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:54:42.699553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-293ce122-50d5-4376-836e-85486ff95928 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:42.700259 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-293ce122-50d5-4376-836e-85486ff95928 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:42.706476 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-293ce122-50d5-4376-836e-85486ff95928 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:42.706925 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-293ce122-50d5-4376-836e-85486ff95928 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:42.707721 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-293ce122-50d5-4376-836e-85486ff95928 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:42.708161 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-293ce122-50d5-4376-836e-85486ff95928 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:42.840261 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-293ce122-50d5-4376-836e-85486ff95928 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:42.847751 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-293ce122-50d5-4376-836e-85486ff95928 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.153109 Jun 17 08:54:42.848348 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 218/447] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:42 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:43.204233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-637dcbd1-54a8-44f8-b551-0b5b7767b699 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:43.204854 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-637dcbd1-54a8-44f8-b551-0b5b7767b699 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:43.211526 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-637dcbd1-54a8-44f8-b551-0b5b7767b699 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:43.211977 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-637dcbd1-54a8-44f8-b551-0b5b7767b699 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:43.212743 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-637dcbd1-54a8-44f8-b551-0b5b7767b699 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:43.213182 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-637dcbd1-54a8-44f8-b551-0b5b7767b699 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:43.242770 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-08ed54af-be3c-4ccc-9b22-ffb61aeaa3be tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:43.243410 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-08ed54af-be3c-4ccc-9b22-ffb61aeaa3be tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:43.249682 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-08ed54af-be3c-4ccc-9b22-ffb61aeaa3be tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:43.253487 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-08ed54af-be3c-4ccc-9b22-ffb61aeaa3be tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:43.253487 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-08ed54af-be3c-4ccc-9b22-ffb61aeaa3be tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:43.253487 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-08ed54af-be3c-4ccc-9b22-ffb61aeaa3be tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:43.402710 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-637dcbd1-54a8-44f8-b551-0b5b7767b699 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:43.410827 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-637dcbd1-54a8-44f8-b551-0b5b7767b699 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.210513 Jun 17 08:54:43.411443 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 230/448] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:43 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:43.417213 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-c2805e69-2cbc-4e63-a9f7-13c2a2d6f0a4 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:43.417820 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-c2805e69-2cbc-4e63-a9f7-13c2a2d6f0a4 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:43.424084 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c2805e69-2cbc-4e63-a9f7-13c2a2d6f0a4 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:43.424530 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c2805e69-2cbc-4e63-a9f7-13c2a2d6f0a4 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:43.425329 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c2805e69-2cbc-4e63-a9f7-13c2a2d6f0a4 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:43.425761 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c2805e69-2cbc-4e63-a9f7-13c2a2d6f0a4 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:43.433410 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-08ed54af-be3c-4ccc-9b22-ffb61aeaa3be tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:43.441431 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-08ed54af-be3c-4ccc-9b22-ffb61aeaa3be tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1512 microversion: 2.1 time: 0.203193 Jun 17 08:54:43.442035 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 219/449] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:43 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1512 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:43.449011 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-b42eec0f-03e3-4fdb-b200-c8dd3187653f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:43.449011 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-b42eec0f-03e3-4fdb-b200-c8dd3187653f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:43.454783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b42eec0f-03e3-4fdb-b200-c8dd3187653f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:43.455291 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b42eec0f-03e3-4fdb-b200-c8dd3187653f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:43.456108 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b42eec0f-03e3-4fdb-b200-c8dd3187653f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:43.456618 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b42eec0f-03e3-4fdb-b200-c8dd3187653f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:43.496804 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c2805e69-2cbc-4e63-a9f7-13c2a2d6f0a4 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:43.504640 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-c2805e69-2cbc-4e63-a9f7-13c2a2d6f0a4 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1300 microversion: 2.1 time: 0.091821 Jun 17 08:54:43.505215 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 231/450] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:43 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:43.594134 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b42eec0f-03e3-4fdb-b200-c8dd3187653f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:43.602057 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-b42eec0f-03e3-4fdb-b200-c8dd3187653f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.159056 Jun 17 08:54:43.602619 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 220/451] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:43 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:43.710116 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-587b4a94-118a-40d3-9306-bc9c85cef4d4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:43.710731 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-587b4a94-118a-40d3-9306-bc9c85cef4d4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:43.712116 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-9f60ace0-4db6-4ad4-8923-b5b19d93f25b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:43.712742 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-9f60ace0-4db6-4ad4-8923-b5b19d93f25b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:43.716912 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-587b4a94-118a-40d3-9306-bc9c85cef4d4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:43.717356 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-587b4a94-118a-40d3-9306-bc9c85cef4d4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:43.718204 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-587b4a94-118a-40d3-9306-bc9c85cef4d4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:43.718642 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-587b4a94-118a-40d3-9306-bc9c85cef4d4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:43.718797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9f60ace0-4db6-4ad4-8923-b5b19d93f25b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:43.719230 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9f60ace0-4db6-4ad4-8923-b5b19d93f25b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:43.720035 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9f60ace0-4db6-4ad4-8923-b5b19d93f25b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:43.720474 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9f60ace0-4db6-4ad4-8923-b5b19d93f25b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:43.911016 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-587b4a94-118a-40d3-9306-bc9c85cef4d4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:43.919276 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-587b4a94-118a-40d3-9306-bc9c85cef4d4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1359 microversion: 2.1 time: 0.213001 Jun 17 08:54:43.919994 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 232/452] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:43 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:43.924405 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-8e001359-4aef-4482-b5e9-5c8b5b65b5b4 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:43.925003 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-8e001359-4aef-4482-b5e9-5c8b5b65b5b4 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:43.930261 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-9f60ace0-4db6-4ad4-8923-b5b19d93f25b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:43.931165 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8e001359-4aef-4482-b5e9-5c8b5b65b5b4 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:43.931666 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8e001359-4aef-4482-b5e9-5c8b5b65b5b4 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:43.932475 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8e001359-4aef-4482-b5e9-5c8b5b65b5b4 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:43.932946 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8e001359-4aef-4482-b5e9-5c8b5b65b5b4 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:43.938371 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-9f60ace0-4db6-4ad4-8923-b5b19d93f25b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:43.939877 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-9f60ace0-4db6-4ad4-8923-b5b19d93f25b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:43.941029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-9f60ace0-4db6-4ad4-8923-b5b19d93f25b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1722 microversion: 2.20 time: 0.232916 Jun 17 08:54:43.941799 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 221/453] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:43 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:54:44.071287 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-8e001359-4aef-4482-b5e9-5c8b5b65b5b4 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:44.079433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-8e001359-4aef-4482-b5e9-5c8b5b65b5b4 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1521 microversion: 2.1 time: 0.158362 Jun 17 08:54:44.080038 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 233/454] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:43 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:44.428945 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-90e93a1a-926b-448b-a6fe-d4dd3bbcf638 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:44.431405 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-90e93a1a-926b-448b-a6fe-d4dd3bbcf638 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:44.437264 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-90e93a1a-926b-448b-a6fe-d4dd3bbcf638 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:44.437834 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-90e93a1a-926b-448b-a6fe-d4dd3bbcf638 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:44.438614 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-90e93a1a-926b-448b-a6fe-d4dd3bbcf638 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:44.439172 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-90e93a1a-926b-448b-a6fe-d4dd3bbcf638 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:44.465551 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-208e840c-972c-4093-afff-c5ee35f63751 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:44.466370 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-208e840c-972c-4093-afff-c5ee35f63751 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:44.476425 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-208e840c-972c-4093-afff-c5ee35f63751 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:44.477197 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-208e840c-972c-4093-afff-c5ee35f63751 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:44.478162 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-208e840c-972c-4093-afff-c5ee35f63751 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:44.478704 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-208e840c-972c-4093-afff-c5ee35f63751 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:44.752880 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-90e93a1a-926b-448b-a6fe-d4dd3bbcf638 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:44.762380 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-90e93a1a-926b-448b-a6fe-d4dd3bbcf638 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.337400 Jun 17 08:54:44.765835 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 222/455] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:44 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:44.774090 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-2c8430b1-09e3-4788-ba74-ed834a1060e2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:44.776310 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-2c8430b1-09e3-4788-ba74-ed834a1060e2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:44.784342 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2c8430b1-09e3-4788-ba74-ed834a1060e2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:44.784942 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2c8430b1-09e3-4788-ba74-ed834a1060e2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:44.785789 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2c8430b1-09e3-4788-ba74-ed834a1060e2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:44.786295 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2c8430b1-09e3-4788-ba74-ed834a1060e2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:44.787709 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-208e840c-972c-4093-afff-c5ee35f63751 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:44.798419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-208e840c-972c-4093-afff-c5ee35f63751 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1512 microversion: 2.1 time: 0.338018 Jun 17 08:54:44.813192 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 234/456] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:44 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1512 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:44.821112 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-762c1bba-58b5-4a79-82af-3877ecd78357 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:44.821853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-762c1bba-58b5-4a79-82af-3877ecd78357 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:44.828374 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-762c1bba-58b5-4a79-82af-3877ecd78357 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:44.828983 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-762c1bba-58b5-4a79-82af-3877ecd78357 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:44.830125 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-762c1bba-58b5-4a79-82af-3877ecd78357 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:44.830264 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-762c1bba-58b5-4a79-82af-3877ecd78357 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:44.834774 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=100 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:44.874628 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2c8430b1-09e3-4788-ba74-ed834a1060e2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:44.875383 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2c8430b1-09e3-4788-ba74-ed834a1060e2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:44.876005 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-2c8430b1-09e3-4788-ba74-ed834a1060e2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lazy-loading 'fault' on Instance uuid 30c5d606-fea9-467c-a074-2a9a1030a461 {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:54:44.948665 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2c8430b1-09e3-4788-ba74-ed834a1060e2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:44.956409 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-2c8430b1-09e3-4788-ba74-ed834a1060e2 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1305 microversion: 2.1 time: 0.189226 Jun 17 08:54:44.957003 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 223/457] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:44 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1305 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:44.962675 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-aa73da48-19e8-4f71-845e-729d6535810d tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:44.963329 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-aa73da48-19e8-4f71-845e-729d6535810d tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:44.969568 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-aa73da48-19e8-4f71-845e-729d6535810d tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:44.976121 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-aa73da48-19e8-4f71-845e-729d6535810d tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:44.976121 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-aa73da48-19e8-4f71-845e-729d6535810d tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:44.976121 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-aa73da48-19e8-4f71-845e-729d6535810d tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:45.028963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-762c1bba-58b5-4a79-82af-3877ecd78357 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:45.036951 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-762c1bba-58b5-4a79-82af-3877ecd78357 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.222564 Jun 17 08:54:45.043481 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 235/458] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:44 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:45.043481 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-81e47a81-4594-45d6-ab7c-42b3ef6449a4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:45.043775 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-81e47a81-4594-45d6-ab7c-42b3ef6449a4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:45.052701 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-81e47a81-4594-45d6-ab7c-42b3ef6449a4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:45.053429 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-81e47a81-4594-45d6-ab7c-42b3ef6449a4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:45.055158 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-81e47a81-4594-45d6-ab7c-42b3ef6449a4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:45.055704 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-81e47a81-4594-45d6-ab7c-42b3ef6449a4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:45.189075 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-aa73da48-19e8-4f71-845e-729d6535810d tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:45.197544 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-aa73da48-19e8-4f71-845e-729d6535810d tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1359 microversion: 2.1 time: 0.238994 Jun 17 08:54:45.206638 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 224/459] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:44 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1359 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:45.206638 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1f491347-1de4-4ce7-bda1-01dde8a945d0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:45.206638 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-1f491347-1de4-4ce7-bda1-01dde8a945d0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:45.209702 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1f491347-1de4-4ce7-bda1-01dde8a945d0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:45.210225 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1f491347-1de4-4ce7-bda1-01dde8a945d0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:45.211031 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1f491347-1de4-4ce7-bda1-01dde8a945d0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:45.211530 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1f491347-1de4-4ce7-bda1-01dde8a945d0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:45.238895 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-81e47a81-4594-45d6-ab7c-42b3ef6449a4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:45.244965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-81e47a81-4594-45d6-ab7c-42b3ef6449a4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:45.246545 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-81e47a81-4594-45d6-ab7c-42b3ef6449a4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:45.247733 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-81e47a81-4594-45d6-ab7c-42b3ef6449a4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1725 microversion: 2.20 time: 0.208628 Jun 17 08:54:45.248301 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 236/460] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:45 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1725 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:45.268754 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-abfb9c9d-6988-4b51-9b42-86f097bf4530 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cbf37b8-ac90-40d2-b7f7-d6deccb2a363"}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:54:45.270300 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-abfb9c9d-6988-4b51-9b42-86f097bf4530 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:45.277450 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-abfb9c9d-6988-4b51-9b42-86f097bf4530 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:45.277925 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-abfb9c9d-6988-4b51-9b42-86f097bf4530 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:45.278702 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-abfb9c9d-6988-4b51-9b42-86f097bf4530 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:45.279286 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-abfb9c9d-6988-4b51-9b42-86f097bf4530 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:45.353751 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-1f491347-1de4-4ce7-bda1-01dde8a945d0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:45.357175 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=100 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:45.361656 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-1f491347-1de4-4ce7-bda1-01dde8a945d0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1501 microversion: 2.1 time: 0.162386 Jun 17 08:54:45.362213 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 225/461] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:45 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:45.377404 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-42fc4ebd-1407-438e-8d6c-e2f6466e83f2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:45.378003 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-42fc4ebd-1407-438e-8d6c-e2f6466e83f2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:45.384235 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-42fc4ebd-1407-438e-8d6c-e2f6466e83f2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:45.384676 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-42fc4ebd-1407-438e-8d6c-e2f6466e83f2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:45.385437 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-42fc4ebd-1407-438e-8d6c-e2f6466e83f2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:45.385869 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-42fc4ebd-1407-438e-8d6c-e2f6466e83f2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:45.540664 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-42fc4ebd-1407-438e-8d6c-e2f6466e83f2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:45.548889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-42fc4ebd-1407-438e-8d6c-e2f6466e83f2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1515 microversion: 2.1 time: 0.175205 Jun 17 08:54:45.549797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 226/462] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:45 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:45.783342 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-85d4df36-456f-48e5-a1f2-4b5fea5295ea tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:45.783964 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-85d4df36-456f-48e5-a1f2-4b5fea5295ea tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:45.790958 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-85d4df36-456f-48e5-a1f2-4b5fea5295ea tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:45.791460 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-85d4df36-456f-48e5-a1f2-4b5fea5295ea tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:45.792234 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-85d4df36-456f-48e5-a1f2-4b5fea5295ea tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:45.792671 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-85d4df36-456f-48e5-a1f2-4b5fea5295ea tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:45.967726 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-85d4df36-456f-48e5-a1f2-4b5fea5295ea tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:45.976339 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-85d4df36-456f-48e5-a1f2-4b5fea5295ea tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.197689 Jun 17 08:54:45.976921 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 227/463] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:45 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:45.981464 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-31b4e306-0ec6-497e-9eca-39cb7747fcc4 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:45.982062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-31b4e306-0ec6-497e-9eca-39cb7747fcc4 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:45.992997 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-31b4e306-0ec6-497e-9eca-39cb7747fcc4 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:45.992997 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-31b4e306-0ec6-497e-9eca-39cb7747fcc4 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:45.992997 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-31b4e306-0ec6-497e-9eca-39cb7747fcc4 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:45.992997 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-31b4e306-0ec6-497e-9eca-39cb7747fcc4 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:46.062786 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-31b4e306-0ec6-497e-9eca-39cb7747fcc4 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:46.073139 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-31b4e306-0ec6-497e-9eca-39cb7747fcc4 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1470 microversion: 2.1 time: 0.095176 Jun 17 08:54:46.074240 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 228/464] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:45 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1470 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:46.079041 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-942e67ad-ac4d-4467-8a73-84e96e4c92a4 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:46.079928 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-942e67ad-ac4d-4467-8a73-84e96e4c92a4 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:46.089900 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-942e67ad-ac4d-4467-8a73-84e96e4c92a4 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:46.090429 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-942e67ad-ac4d-4467-8a73-84e96e4c92a4 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:46.091281 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-942e67ad-ac4d-4467-8a73-84e96e4c92a4 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:46.091818 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-942e67ad-ac4d-4467-8a73-84e96e4c92a4 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:46.126961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-942e67ad-ac4d-4467-8a73-84e96e4c92a4 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:46.127068 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-942e67ad-ac4d-4467-8a73-84e96e4c92a4 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:46.127600 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-942e67ad-ac4d-4467-8a73-84e96e4c92a4 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lazy-loading 'fault' on Instance uuid 30c5d606-fea9-467c-a074-2a9a1030a461 {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:54:46.170052 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-942e67ad-ac4d-4467-8a73-84e96e4c92a4 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:46.177420 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-942e67ad-ac4d-4467-8a73-84e96e4c92a4 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1305 microversion: 2.1 time: 0.102059 Jun 17 08:54:46.177976 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 229/465] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:46 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:46.184331 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3106c643-13f2-4a34-93f1-2695c6fd48df tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:46.184937 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-3106c643-13f2-4a34-93f1-2695c6fd48df tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:46.190783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3106c643-13f2-4a34-93f1-2695c6fd48df tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:46.191230 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3106c643-13f2-4a34-93f1-2695c6fd48df tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:46.192025 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3106c643-13f2-4a34-93f1-2695c6fd48df tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:46.192462 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3106c643-13f2-4a34-93f1-2695c6fd48df tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:46.345821 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3106c643-13f2-4a34-93f1-2695c6fd48df tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:46.354116 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-abfb9c9d-6988-4b51-9b42-86f097bf4530 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "POST /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.089098 Jun 17 08:54:46.355640 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 237/466] 10.222.0.78 () {62 vars in 1363 bytes} [Fri Jun 17 08:54:45 2022] POST /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976/os-volume_attachments => generated 188 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 08:54:46.360872 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-25c8cefd-c4fe-4b67-80b6-223c563a6c95 req-1092cc25-d2c4-46cc-b0f2-4b323ee02314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edcd67d0-7a53-4e37-a947-a077ffd9bd71", "name": "network-vif-deleted", "tag": "0089423c-f96d-4e7e-9d00-2111a2dc1752"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:54:46.375423 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-25c8cefd-c4fe-4b67-80b6-223c563a6c95 req-1092cc25-d2c4-46cc-b0f2-4b323ee02314 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:46.375423 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-25c8cefd-c4fe-4b67-80b6-223c563a6c95 req-1092cc25-d2c4-46cc-b0f2-4b323ee02314 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:46.388420 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-3106c643-13f2-4a34-93f1-2695c6fd48df tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1367 microversion: 2.1 time: 0.207749 Jun 17 08:54:46.388676 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-25c8cefd-c4fe-4b67-80b6-223c563a6c95 req-1092cc25-d2c4-46cc-b0f2-4b323ee02314 service nova] Creating event network-vif-deleted:0089423c-f96d-4e7e-9d00-2111a2dc1752 for instance edcd67d0-7a53-4e37-a947-a077ffd9bd71 on hv-cinder-79760 Jun 17 08:54:46.389021 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 230/467] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:46 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:46.394512 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-25c8cefd-c4fe-4b67-80b6-223c563a6c95 req-1092cc25-d2c4-46cc-b0f2-4b323ee02314 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037221 Jun 17 08:54:46.395657 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 238/468] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:54:46.402915 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-9488d6a9-3718-479d-a241-6158c4b61ced tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:46.403884 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-9488d6a9-3718-479d-a241-6158c4b61ced tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:46.412677 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9488d6a9-3718-479d-a241-6158c4b61ced tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:46.423070 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9488d6a9-3718-479d-a241-6158c4b61ced tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:46.423978 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9488d6a9-3718-479d-a241-6158c4b61ced tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:46.424427 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9488d6a9-3718-479d-a241-6158c4b61ced tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:46.504138 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-2f973bd5-130d-46fd-a741-df6e342fba64 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:54:46.504810 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-2f973bd5-130d-46fd-a741-df6e342fba64 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:46.511899 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2f973bd5-130d-46fd-a741-df6e342fba64 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:46.512349 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2f973bd5-130d-46fd-a741-df6e342fba64 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:46.513209 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2f973bd5-130d-46fd-a741-df6e342fba64 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:46.513650 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2f973bd5-130d-46fd-a741-df6e342fba64 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:46.590142 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-9488d6a9-3718-479d-a241-6158c4b61ced tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:46.598185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-9488d6a9-3718-479d-a241-6158c4b61ced tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1359 microversion: 2.1 time: 0.198947 Jun 17 08:54:46.598781 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 231/469] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:46 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:46.732109 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-2f973bd5-130d-46fd-a741-df6e342fba64 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "POST /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976/action" status: 202 len: 0 microversion: 2.20 time: 0.232706 Jun 17 08:54:46.732612 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 239/470] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jun 17 08:54:46 2022] POST /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 17 08:54:46.740881 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0ebf0506-961e-45f5-94b2-6060828b5dd7 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:46.742152 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0ebf0506-961e-45f5-94b2-6060828b5dd7 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:46.744098 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:46.748780 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0ebf0506-961e-45f5-94b2-6060828b5dd7 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:46.749228 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0ebf0506-961e-45f5-94b2-6060828b5dd7 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:46.750003 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0ebf0506-961e-45f5-94b2-6060828b5dd7 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:46.750455 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0ebf0506-961e-45f5-94b2-6060828b5dd7 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:46.893974 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-299abdf6-114f-4b2f-b922-77a05272f931 req-f14cdeba-b90a-4a9b-b624-113eee75f636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e254b695-5369-48d6-9966-64f25873dc0d", "name": "network-vif-plugged", "status": "completed", "tag": "5a6e2dcc-1d88-4ebd-8cce-063737a7db08"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:54:46.910279 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-299abdf6-114f-4b2f-b922-77a05272f931 req-f14cdeba-b90a-4a9b-b624-113eee75f636 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:46.910866 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-299abdf6-114f-4b2f-b922-77a05272f931 req-f14cdeba-b90a-4a9b-b624-113eee75f636 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:46.930492 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-299abdf6-114f-4b2f-b922-77a05272f931 req-f14cdeba-b90a-4a9b-b624-113eee75f636 service nova] Creating event network-vif-plugged:5a6e2dcc-1d88-4ebd-8cce-063737a7db08 for instance e254b695-5369-48d6-9966-64f25873dc0d on hv-cinder-79760 Jun 17 08:54:46.941162 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-299abdf6-114f-4b2f-b922-77a05272f931 req-f14cdeba-b90a-4a9b-b624-113eee75f636 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050425 Jun 17 08:54:46.949178 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 240/471] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:54:46.968096 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0ebf0506-961e-45f5-94b2-6060828b5dd7 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:46.978177 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0ebf0506-961e-45f5-94b2-6060828b5dd7 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:46.980070 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0ebf0506-961e-45f5-94b2-6060828b5dd7 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:46.981454 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0ebf0506-961e-45f5-94b2-6060828b5dd7 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1811 microversion: 2.20 time: 0.244542 Jun 17 08:54:46.982236 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 232/472] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:46 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1811 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:46.998147 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-b97151c4-24cc-48ed-ac09-769a393066dc tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:46.999934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-b97151c4-24cc-48ed-ac09-769a393066dc tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:47.010495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b97151c4-24cc-48ed-ac09-769a393066dc tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:47.011631 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b97151c4-24cc-48ed-ac09-769a393066dc tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:47.015309 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b97151c4-24cc-48ed-ac09-769a393066dc tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:47.015309 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b97151c4-24cc-48ed-ac09-769a393066dc tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:47.091006 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-f3e2e7aa-112b-4199-b336-1ef17a288e78 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:47.091649 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-f3e2e7aa-112b-4199-b336-1ef17a288e78 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:47.101774 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f3e2e7aa-112b-4199-b336-1ef17a288e78 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:47.102220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f3e2e7aa-112b-4199-b336-1ef17a288e78 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:47.104545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f3e2e7aa-112b-4199-b336-1ef17a288e78 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:47.104545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f3e2e7aa-112b-4199-b336-1ef17a288e78 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:47.201857 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f3e2e7aa-112b-4199-b336-1ef17a288e78 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:47.230231 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-b97151c4-24cc-48ed-ac09-769a393066dc tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:47.234897 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-f3e2e7aa-112b-4199-b336-1ef17a288e78 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1303 microversion: 2.1 time: 0.125514 Jun 17 08:54:47.235605 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 233/473] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:47 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1303 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:47.242468 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-b97151c4-24cc-48ed-ac09-769a393066dc tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.252068 Jun 17 08:54:47.243866 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 241/474] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:46 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:47.253123 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3ef7acbe-9939-4440-89d5-018cb46481c0 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:47.256217 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-3ef7acbe-9939-4440-89d5-018cb46481c0 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:47.286263 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3ef7acbe-9939-4440-89d5-018cb46481c0 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:47.286995 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3ef7acbe-9939-4440-89d5-018cb46481c0 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:47.287842 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3ef7acbe-9939-4440-89d5-018cb46481c0 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:47.289493 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3ef7acbe-9939-4440-89d5-018cb46481c0 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:47.361419 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3ef7acbe-9939-4440-89d5-018cb46481c0 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:47.361957 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3ef7acbe-9939-4440-89d5-018cb46481c0 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:47.362459 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-3ef7acbe-9939-4440-89d5-018cb46481c0 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lazy-loading 'fault' on Instance uuid 30c5d606-fea9-467c-a074-2a9a1030a461 {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:54:47.405288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-828579d3-d200-479f-b66b-64bb7f3168dc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:47.405905 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-828579d3-d200-479f-b66b-64bb7f3168dc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:47.418577 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-828579d3-d200-479f-b66b-64bb7f3168dc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:47.419028 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-828579d3-d200-479f-b66b-64bb7f3168dc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:47.420763 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-828579d3-d200-479f-b66b-64bb7f3168dc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:47.421485 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-828579d3-d200-479f-b66b-64bb7f3168dc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:47.435317 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3ef7acbe-9939-4440-89d5-018cb46481c0 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8885e2308ed64b52afcb6b6e6b67bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5809f2e310d4768acbf28fb54280f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:47.451919 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-3ef7acbe-9939-4440-89d5-018cb46481c0 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 200 len: 1305 microversion: 2.1 time: 0.212919 Jun 17 08:54:47.462528 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 234/475] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:47 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 1305 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:47.548534 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3e147747-3845-4a4b-ab8d-1785a9115272 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:54:47.550063 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-3e147747-3845-4a4b-ab8d-1785a9115272 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:47.561268 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3e147747-3845-4a4b-ab8d-1785a9115272 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:47.562149 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3e147747-3845-4a4b-ab8d-1785a9115272 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:47.564084 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3e147747-3845-4a4b-ab8d-1785a9115272 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:47.565172 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3e147747-3845-4a4b-ab8d-1785a9115272 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:47.594274 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-3e147747-3845-4a4b-ab8d-1785a9115272 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lazy-loading 'flavor' on Instance uuid 597a895e-45db-42bf-9c7f-40a13eedc48b {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:54:47.620172 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-828579d3-d200-479f-b66b-64bb7f3168dc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:47.631887 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-828579d3-d200-479f-b66b-64bb7f3168dc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1556 microversion: 2.1 time: 0.227019 Jun 17 08:54:47.631887 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 242/476] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:47 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1556 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:47.634421 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-67fc8ce8-1a69-48fb-b65a-2150e2aedbe0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:47.635132 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-67fc8ce8-1a69-48fb-b65a-2150e2aedbe0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:47.646610 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-67fc8ce8-1a69-48fb-b65a-2150e2aedbe0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:47.647340 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-67fc8ce8-1a69-48fb-b65a-2150e2aedbe0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:47.648833 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-67fc8ce8-1a69-48fb-b65a-2150e2aedbe0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:47.649273 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-67fc8ce8-1a69-48fb-b65a-2150e2aedbe0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:47.900536 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-67fc8ce8-1a69-48fb-b65a-2150e2aedbe0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:47.908132 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-67fc8ce8-1a69-48fb-b65a-2150e2aedbe0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1359 microversion: 2.1 time: 0.278002 Jun 17 08:54:47.909250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 243/477] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:47 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1359 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:47.916176 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-92cad0b3-4026-4b1e-b4f9-ddfdc0300b2c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:47.920409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-92cad0b3-4026-4b1e-b4f9-ddfdc0300b2c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:47.923557 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-92cad0b3-4026-4b1e-b4f9-ddfdc0300b2c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:47.924008 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-92cad0b3-4026-4b1e-b4f9-ddfdc0300b2c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:47.924768 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-92cad0b3-4026-4b1e-b4f9-ddfdc0300b2c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:47.925200 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-92cad0b3-4026-4b1e-b4f9-ddfdc0300b2c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:48.013765 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-3e147747-3845-4a4b-ab8d-1785a9115272 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "POST /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b/action" status: 200 len: 32 microversion: 2.1 time: 0.469979 Jun 17 08:54:48.014694 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 235/478] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jun 17 08:54:47 2022] POST /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b/action => generated 32 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 08:54:48.018662 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-92cad0b3-4026-4b1e-b4f9-ddfdc0300b2c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095991 Jun 17 08:54:48.021467 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 244/479] 10.222.0.78 () {58 vars in 1274 bytes} [Fri Jun 17 08:54:47 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:54:48.044128 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-40435b78-be7f-4024-be27-11e7c7a7ad49 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:48.047208 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-40435b78-be7f-4024-be27-11e7c7a7ad49 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:48.050965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-b424618d-a75b-4253-adc3-cd19968b8fc2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:48.052905 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-b424618d-a75b-4253-adc3-cd19968b8fc2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:48.055995 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:48.067187 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-40435b78-be7f-4024-be27-11e7c7a7ad49 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:48.067909 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-40435b78-be7f-4024-be27-11e7c7a7ad49 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:48.070656 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-40435b78-be7f-4024-be27-11e7c7a7ad49 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:48.071221 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b424618d-a75b-4253-adc3-cd19968b8fc2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:48.071558 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-40435b78-be7f-4024-be27-11e7c7a7ad49 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:48.072857 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b424618d-a75b-4253-adc3-cd19968b8fc2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:48.073681 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b424618d-a75b-4253-adc3-cd19968b8fc2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:48.074118 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b424618d-a75b-4253-adc3-cd19968b8fc2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:48.518415 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-40435b78-be7f-4024-be27-11e7c7a7ad49 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:48.533452 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-40435b78-be7f-4024-be27-11e7c7a7ad49 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:48.539512 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-40435b78-be7f-4024-be27-11e7c7a7ad49 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:48.541438 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-40435b78-be7f-4024-be27-11e7c7a7ad49 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1751 microversion: 2.20 time: 0.525379 Jun 17 08:54:48.550010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 236/480] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:48 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1751 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:48.550010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-e1ed09ce-3825-43a8-ac71-916b1c99f066 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:48.550010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-e1ed09ce-3825-43a8-ac71-916b1c99f066 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:48.555794 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e1ed09ce-3825-43a8-ac71-916b1c99f066 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:48.556383 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e1ed09ce-3825-43a8-ac71-916b1c99f066 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:48.559334 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e1ed09ce-3825-43a8-ac71-916b1c99f066 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:48.559334 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e1ed09ce-3825-43a8-ac71-916b1c99f066 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:48.597380 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e1ed09ce-3825-43a8-ac71-916b1c99f066 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:48.598035 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e1ed09ce-3825-43a8-ac71-916b1c99f066 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:48.598290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-e1ed09ce-3825-43a8-ac71-916b1c99f066 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lazy-loading 'fault' on Instance uuid edcd67d0-7a53-4e37-a947-a077ffd9bd71 {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:54:48.709643 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-b424618d-a75b-4253-adc3-cd19968b8fc2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:48.711102 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-e1ed09ce-3825-43a8-ac71-916b1c99f066 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:48.727908 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-b424618d-a75b-4253-adc3-cd19968b8fc2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.703449 Jun 17 08:54:48.747691 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-e1ed09ce-3825-43a8-ac71-916b1c99f066 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 200 len: 1308 microversion: 2.1 time: 0.186504 Jun 17 08:54:48.747691 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 237/481] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:48 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 1308 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:48.748145 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 245/482] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:48 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:48.762820 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1ba2ed95-f63a-4643-acfa-48fa2a19c52f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:48.763519 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-1ba2ed95-f63a-4643-acfa-48fa2a19c52f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:48.765035 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a32c1a94-e99b-4d34-aff7-efd1fecf8893 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:48.765703 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a32c1a94-e99b-4d34-aff7-efd1fecf8893 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] [instance: 30c5d606-fea9-467c-a074-2a9a1030a461] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:48.787176 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1ba2ed95-f63a-4643-acfa-48fa2a19c52f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:48.787650 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1ba2ed95-f63a-4643-acfa-48fa2a19c52f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:48.788492 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1ba2ed95-f63a-4643-acfa-48fa2a19c52f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:48.788961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1ba2ed95-f63a-4643-acfa-48fa2a19c52f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:48.792981 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a32c1a94-e99b-4d34-aff7-efd1fecf8893 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:48.795334 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a32c1a94-e99b-4d34-aff7-efd1fecf8893 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:48.796173 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a32c1a94-e99b-4d34-aff7-efd1fecf8893 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:48.796819 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a32c1a94-e99b-4d34-aff7-efd1fecf8893 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:48.830004 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-a32c1a94-e99b-4d34-aff7-efd1fecf8893 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] HTTP exception thrown: Instance 30c5d606-fea9-467c-a074-2a9a1030a461 could not be found. Jun 17 08:54:48.833289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a32c1a94-e99b-4d34-aff7-efd1fecf8893 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Request method failure captured: Jun 17 08:54:48.833289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 HTTP/1.1 Jun 17 08:54:48.833289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:54:48.833289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:54:48.833289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:54:48.833289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 08:54:48.833289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:54:48.833289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:54:48.833289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:54:48.833289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:54:48.833289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirEEgxcwuxMJlN3DVWMMays_t1FaQokqp751wcvU0YRQB1ZI4TKxDYN3jxz_sSQCvLjdk_FdbtKpDX1hJXYHOAGrjKXIACD1_9b38PiOIZMXWtrdUB1EcmW3saEZmU5R_U4bF7WrhZNZXefNSq5DK-OFL0SskedCFTm7NcXLSr4Tp60A Jun 17 08:54:48.833289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:54:48.833289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:54:48.833289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:54:48.833289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:54:48.833289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:54:48.833289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:54:48.833289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: f5809f2e310d4768acbf28fb54280f35 Jun 17 08:54:48.833289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-VolumesNegativeTest-730410836 Jun 17 08:54:48.833289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:54:48.833289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:54:48.834558 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f5809f2e310d4768acbf28fb54280f35"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f5809f2e310d4768acbf28fb54280f35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f5809f2e310d4768acbf28fb54280f35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f5809f2e310d4768acbf28fb54280f35"}]}] Jun 17 08:54:48.834558 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-VolumesNegativeTest-730410836 Jun 17 08:54:48.834558 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: f5809f2e310d4768acbf28fb54280f35 Jun 17 08:54:48.834558 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-VolumesNegativeTest-730410836 Jun 17 08:54:48.834558 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-VolumesNegativeTest-730410836-project Jun 17 08:54:48.834558 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:54:48.834558 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:54:48.834558 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: 8885e2308ed64b52afcb6b6e6b67bffe Jun 17 08:54:48.834558 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-VolumesNegativeTest-730410836-project Jun 17 08:54:48.834558 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 08:54:48.834558 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Instance 30c5d606-fea9-467c-a074-2a9a1030a461 could not be found. Jun 17 08:54:48.834558 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'id': '30c5d606-fea9-467c-a074-2a9a1030a461'} Jun 17 08:54:48.835927 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:54:48.835927 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:54:48.835927 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:54:48.835927 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:54:48.835927 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:54:48.835927 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:54:48.835927 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:54:48.835927 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:54:48.835927 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:54:48.835927 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:54:48.835927 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c5d606-fea9-467c-a074-2a9a1030a461 could not be found. Jun 17 08:54:48.835927 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:54:48.835927 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:54:48.835927 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:54:48.835927 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:54:48.835927 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:54:48.835927 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:54:48.835927 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:54:48.835927 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:54:48.835927 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:54:48.837183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:54:48.837183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:54:48.837183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:54:48.837183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:54:48.837183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:54:48.837183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:54:48.837183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:54:48.837183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c5d606-fea9-467c-a074-2a9a1030a461 could not be found. Jun 17 08:54:48.837183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:54:48.837183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:54:48.837183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:54:48.837183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:54:48.837183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:54:48.837183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:54:48.837183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:54:48.837183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:54:48.837183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c5d606-fea9-467c-a074-2a9a1030a461 could not be found. Jun 17 08:54:48.837183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:54:48.838241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a32c1a94-e99b-4d34-aff7-efd1fecf8893 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] Returning 404 to user: Instance 30c5d606-fea9-467c-a074-2a9a1030a461 could not be found. {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:54:48.838241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a32c1a94-e99b-4d34-aff7-efd1fecf8893 tempest-VolumesNegativeTest-730410836 tempest-VolumesNegativeTest-730410836-project] 10.222.0.78 "GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461" status: 404 len: 111 microversion: 2.1 time: 0.083328 Jun 17 08:54:48.838241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 246/483] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:48 2022] GET /compute/v2.1/servers/30c5d606-fea9-467c-a074-2a9a1030a461 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:54:48.928288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-bf973e7c-f802-4085-864b-49df3e4d2808 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:48.928993 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-bf973e7c-f802-4085-864b-49df3e4d2808 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:48.935692 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bf973e7c-f802-4085-864b-49df3e4d2808 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:48.936914 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bf973e7c-f802-4085-864b-49df3e4d2808 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:48.937615 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bf973e7c-f802-4085-864b-49df3e4d2808 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:48.938334 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bf973e7c-f802-4085-864b-49df3e4d2808 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:49.489439 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-1ba2ed95-f63a-4643-acfa-48fa2a19c52f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:49.500483 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-1ba2ed95-f63a-4643-acfa-48fa2a19c52f tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.767831 Jun 17 08:54:49.501071 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 238/484] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:48 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:49.561258 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-bf973e7c-f802-4085-864b-49df3e4d2808 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:49.565785 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-175be86b-12dc-46be-9614-efa70b9aa880 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:49.566440 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-175be86b-12dc-46be-9614-efa70b9aa880 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:49.597036 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-175be86b-12dc-46be-9614-efa70b9aa880 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:49.597492 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-175be86b-12dc-46be-9614-efa70b9aa880 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:49.598280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-175be86b-12dc-46be-9614-efa70b9aa880 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:49.598828 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-bf973e7c-f802-4085-864b-49df3e4d2808 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1359 microversion: 2.1 time: 0.670988 Jun 17 08:54:49.601506 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 247/485] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:48 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1359 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:49.602311 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-175be86b-12dc-46be-9614-efa70b9aa880 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:49.663594 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:49.748396 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-aa2da176-d03d-41b1-962a-db7170d2d439 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:49.752798 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-aa2da176-d03d-41b1-962a-db7170d2d439 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: edcd67d0-7a53-4e37-a947-a077ffd9bd71] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:49.763136 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-aa2da176-d03d-41b1-962a-db7170d2d439 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:49.763584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-aa2da176-d03d-41b1-962a-db7170d2d439 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:49.764590 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-aa2da176-d03d-41b1-962a-db7170d2d439 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:49.765042 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-aa2da176-d03d-41b1-962a-db7170d2d439 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:49.805359 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-aa2da176-d03d-41b1-962a-db7170d2d439 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] HTTP exception thrown: Instance edcd67d0-7a53-4e37-a947-a077ffd9bd71 could not be found. Jun 17 08:54:49.810815 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-aa2da176-d03d-41b1-962a-db7170d2d439 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Request method failure captured: Jun 17 08:54:49.810815 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 HTTP/1.1 Jun 17 08:54:49.810815 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:54:49.810815 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:54:49.810815 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:54:49.810815 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 08:54:49.810815 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:54:49.810815 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:54:49.810815 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:54:49.810815 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:54:49.810815 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirEDoc7FUSMtcf542hpXJXXUTfvMnPlxZjfopeW7-XxYRtKNCaxpRUyLj-KWS2JeFUwmVpe-f0yRCNZwakqm-W_uhDmCf3E3l278edADspc7gC04YX22GrCukVJ71ud6dOqTK8wWGL9VBAMpY_yZXJcX7R6ptHCC79-iD1R-v_Fwwqt8 Jun 17 08:54:49.810815 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:54:49.810815 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:54:49.810815 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:54:49.810815 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:54:49.810815 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:54:49.810815 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:54:49.810815 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: 25f8de28a0664821af43d9cdccab292d Jun 17 08:54:49.810815 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1946185046 Jun 17 08:54:49.810815 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:54:49.810815 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:54:49.816823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/25f8de28a0664821af43d9cdccab292d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/25f8de28a0664821af43d9cdccab292d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_25f8de28a0664821af43d9cdccab292d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/25f8de28a0664821af43d9cdccab292d"}]}] Jun 17 08:54:49.816823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-VolumesSnapshotTestJSON-1946185046 Jun 17 08:54:49.816823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: 25f8de28a0664821af43d9cdccab292d Jun 17 08:54:49.816823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1946185046 Jun 17 08:54:49.816823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-VolumesSnapshotTestJSON-1946185046-project Jun 17 08:54:49.816823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:54:49.816823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:54:49.816823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: f571731515754890874b862a1407ebc0 Jun 17 08:54:49.816823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-VolumesSnapshotTestJSON-1946185046-project Jun 17 08:54:49.816823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 08:54:49.816823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Instance edcd67d0-7a53-4e37-a947-a077ffd9bd71 could not be found. Jun 17 08:54:49.816823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'id': 'edcd67d0-7a53-4e37-a947-a077ffd9bd71'} Jun 17 08:54:49.817751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:54:49.817751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:54:49.817751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:54:49.817751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:54:49.817751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:54:49.817751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:54:49.817751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:54:49.817751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:54:49.817751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:54:49.817751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:54:49.817751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edcd67d0-7a53-4e37-a947-a077ffd9bd71 could not be found. Jun 17 08:54:49.817751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:54:49.817751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:54:49.817751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:54:49.817751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:54:49.817751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:54:49.817751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:54:49.817751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:54:49.817751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:54:49.817751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:54:49.818862 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:54:49.818862 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:54:49.818862 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:54:49.818862 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:54:49.818862 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:54:49.818862 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:54:49.818862 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:54:49.818862 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edcd67d0-7a53-4e37-a947-a077ffd9bd71 could not be found. Jun 17 08:54:49.818862 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:54:49.818862 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:54:49.818862 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:54:49.818862 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:54:49.818862 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:54:49.818862 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:54:49.818862 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:54:49.818862 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:54:49.818862 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edcd67d0-7a53-4e37-a947-a077ffd9bd71 could not be found. Jun 17 08:54:49.818862 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:54:49.820876 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-aa2da176-d03d-41b1-962a-db7170d2d439 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Returning 404 to user: Instance edcd67d0-7a53-4e37-a947-a077ffd9bd71 could not be found. {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:54:49.820876 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-aa2da176-d03d-41b1-962a-db7170d2d439 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71" status: 404 len: 111 microversion: 2.1 time: 0.072070 Jun 17 08:54:49.820876 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 248/486] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:49 2022] GET /compute/v2.1/servers/edcd67d0-7a53-4e37-a947-a077ffd9bd71 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 08:54:49.827279 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-351870de-2e0d-4615-8a4b-7dc2f2a8fa59 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:49.827939 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-351870de-2e0d-4615-8a4b-7dc2f2a8fa59 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:49.847031 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-351870de-2e0d-4615-8a4b-7dc2f2a8fa59 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:49.847621 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-351870de-2e0d-4615-8a4b-7dc2f2a8fa59 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:49.848411 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-351870de-2e0d-4615-8a4b-7dc2f2a8fa59 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:49.848867 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-351870de-2e0d-4615-8a4b-7dc2f2a8fa59 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:50.124255 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-175be86b-12dc-46be-9614-efa70b9aa880 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:50.134301 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-175be86b-12dc-46be-9614-efa70b9aa880 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:50.135836 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-175be86b-12dc-46be-9614-efa70b9aa880 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:50.137077 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-175be86b-12dc-46be-9614-efa70b9aa880 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1751 microversion: 2.20 time: 0.580223 Jun 17 08:54:50.148187 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 239/487] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:49 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1751 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:50.193313 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-351870de-2e0d-4615-8a4b-7dc2f2a8fa59 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:50.206864 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-351870de-2e0d-4615-8a4b-7dc2f2a8fa59 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.384768 Jun 17 08:54:50.207649 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 249/488] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:49 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:50.518062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-94b6f991-73e7-4d32-a7be-b47d4d44ed27 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:50.518792 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-94b6f991-73e7-4d32-a7be-b47d4d44ed27 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:50.526712 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-94b6f991-73e7-4d32-a7be-b47d4d44ed27 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:50.527733 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-94b6f991-73e7-4d32-a7be-b47d4d44ed27 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:50.533545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-94b6f991-73e7-4d32-a7be-b47d4d44ed27 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:50.533545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-94b6f991-73e7-4d32-a7be-b47d4d44ed27 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:50.618857 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-d90eeafe-5639-4396-a186-bffb42dfe5f0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:50.619518 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-d90eeafe-5639-4396-a186-bffb42dfe5f0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:50.638686 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d90eeafe-5639-4396-a186-bffb42dfe5f0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:50.639268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d90eeafe-5639-4396-a186-bffb42dfe5f0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:50.640198 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d90eeafe-5639-4396-a186-bffb42dfe5f0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:50.640671 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d90eeafe-5639-4396-a186-bffb42dfe5f0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:50.845945 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-94b6f991-73e7-4d32-a7be-b47d4d44ed27 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:50.856133 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-94b6f991-73e7-4d32-a7be-b47d4d44ed27 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.342515 Jun 17 08:54:50.867278 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 240/489] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:50 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:50.873166 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-74ad01a9-71bb-4829-8a65-75b1c0275839 req-904f9fce-a5fd-4c9f-b24d-46639ec2de27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d", "tag": "865d7ab5-9d19-42eb-8363-e2eb81b9295c"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:54:50.882480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-74ad01a9-71bb-4829-8a65-75b1c0275839 req-904f9fce-a5fd-4c9f-b24d-46639ec2de27 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:50.882928 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-74ad01a9-71bb-4829-8a65-75b1c0275839 req-904f9fce-a5fd-4c9f-b24d-46639ec2de27 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:50.892198 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-d90eeafe-5639-4396-a186-bffb42dfe5f0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:50.902472 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-d90eeafe-5639-4396-a186-bffb42dfe5f0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1548 microversion: 2.1 time: 0.287448 Jun 17 08:54:50.903190 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 250/490] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:50 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1548 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:50.904355 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-74ad01a9-71bb-4829-8a65-75b1c0275839 req-904f9fce-a5fd-4c9f-b24d-46639ec2de27 service nova] Creating event network-changed:865d7ab5-9d19-42eb-8363-e2eb81b9295c for instance 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d on hv-cinder-79760 Jun 17 08:54:50.917315 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-74ad01a9-71bb-4829-8a65-75b1c0275839 req-904f9fce-a5fd-4c9f-b24d-46639ec2de27 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048219 Jun 17 08:54:50.918090 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 241/491] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:54:50.923539 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-3d8d3a44-26ff-4ca2-911e-38390f59045c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:50.924402 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-3d8d3a44-26ff-4ca2-911e-38390f59045c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:50.931508 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3d8d3a44-26ff-4ca2-911e-38390f59045c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:50.932045 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3d8d3a44-26ff-4ca2-911e-38390f59045c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:50.932880 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3d8d3a44-26ff-4ca2-911e-38390f59045c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:50.933825 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3d8d3a44-26ff-4ca2-911e-38390f59045c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:50.937880 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:51.113841 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-3d8d3a44-26ff-4ca2-911e-38390f59045c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:51.123953 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-3d8d3a44-26ff-4ca2-911e-38390f59045c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1548 microversion: 2.1 time: 0.207682 Jun 17 08:54:51.134578 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 251/492] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:50 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1548 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:51.140811 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-b72c1f61-a8e6-4583-a200-a915adc8dca0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:51.144756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b72c1f61-a8e6-4583-a200-a915adc8dca0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:51.145511 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-b72c1f61-a8e6-4583-a200-a915adc8dca0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Searching by: {'deleted': False, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17'} {{(pid=129875) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 17 08:54:51.153176 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b72c1f61-a8e6-4583-a200-a915adc8dca0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:51.154547 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b72c1f61-a8e6-4583-a200-a915adc8dca0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:51.155292 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b72c1f61-a8e6-4583-a200-a915adc8dca0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:51.155773 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b72c1f61-a8e6-4583-a200-a915adc8dca0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:51.156955 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-66da0435-26e0-47de-959d-aaa8679c2d61 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:51.157634 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-66da0435-26e0-47de-959d-aaa8679c2d61 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:51.164853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-66da0435-26e0-47de-959d-aaa8679c2d61 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:51.165381 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-66da0435-26e0-47de-959d-aaa8679c2d61 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:51.166212 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-66da0435-26e0-47de-959d-aaa8679c2d61 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:51.166710 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-66da0435-26e0-47de-959d-aaa8679c2d61 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:51.255247 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.multi_cell_list [None req-b72c1f61-a8e6-4583-a200-a915adc8dca0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 17 08:54:51.333133 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-66da0435-26e0-47de-959d-aaa8679c2d61 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:51.345209 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-66da0435-26e0-47de-959d-aaa8679c2d61 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:51.346708 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-66da0435-26e0-47de-959d-aaa8679c2d61 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:51.348124 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-66da0435-26e0-47de-959d-aaa8679c2d61 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1753 microversion: 2.20 time: 0.196146 Jun 17 08:54:51.351400 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 252/493] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:51 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1753 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:51.355507 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-1ec7f419-c63e-4de9-80a4-dc481e6fa558 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:51.355507 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-1ec7f419-c63e-4de9-80a4-dc481e6fa558 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:51.361563 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1ec7f419-c63e-4de9-80a4-dc481e6fa558 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:51.361945 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1ec7f419-c63e-4de9-80a4-dc481e6fa558 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:51.362713 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1ec7f419-c63e-4de9-80a4-dc481e6fa558 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:51.363491 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1ec7f419-c63e-4de9-80a4-dc481e6fa558 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:51.378392 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-b72c1f61-a8e6-4583-a200-a915adc8dca0 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.241666 Jun 17 08:54:51.379197 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 242/494] 10.222.0.78 () {58 vars in 1124 bytes} [Fri Jun 17 08:54:51 2022] GET /compute/v2.1/servers => generated 343 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:54:51.393919 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-cd453855-822e-4028-89c4-f01bc5b339e9 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:51.395846 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-cd453855-822e-4028-89c4-f01bc5b339e9 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:51.407531 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-cd453855-822e-4028-89c4-f01bc5b339e9 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:51.414742 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-cd453855-822e-4028-89c4-f01bc5b339e9 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:51.414742 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-cd453855-822e-4028-89c4-f01bc5b339e9 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:51.414742 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-cd453855-822e-4028-89c4-f01bc5b339e9 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:51.594270 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-1ec7f419-c63e-4de9-80a4-dc481e6fa558 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:51.603785 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-1ec7f419-c63e-4de9-80a4-dc481e6fa558 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.253372 Jun 17 08:54:51.604538 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 253/495] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:51 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:51.631558 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-cd453855-822e-4028-89c4-f01bc5b339e9 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:51.636785 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-cd453855-822e-4028-89c4-f01bc5b339e9 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1548 microversion: 2.1 time: 0.249849 Jun 17 08:54:51.637393 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 243/496] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:51 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1548 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:51.873414 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-d4556c14-e95b-48b3-a145-2fd634131ca4 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:51.874066 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-d4556c14-e95b-48b3-a145-2fd634131ca4 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:51.880684 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d4556c14-e95b-48b3-a145-2fd634131ca4 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:51.881130 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d4556c14-e95b-48b3-a145-2fd634131ca4 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:51.882553 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d4556c14-e95b-48b3-a145-2fd634131ca4 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:51.882906 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d4556c14-e95b-48b3-a145-2fd634131ca4 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:52.021115 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-d4556c14-e95b-48b3-a145-2fd634131ca4 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:52.029972 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-d4556c14-e95b-48b3-a145-2fd634131ca4 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.160422 Jun 17 08:54:52.039890 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 254/497] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:51 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:52.368207 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-4b805962-2697-4048-b288-8758cd088831 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:52.369122 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-4b805962-2697-4048-b288-8758cd088831 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:52.377946 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4b805962-2697-4048-b288-8758cd088831 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:52.377946 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4b805962-2697-4048-b288-8758cd088831 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:52.377946 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4b805962-2697-4048-b288-8758cd088831 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:52.377946 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4b805962-2697-4048-b288-8758cd088831 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:52.520479 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-4b805962-2697-4048-b288-8758cd088831 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:52.534803 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-4b805962-2697-4048-b288-8758cd088831 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:52.534803 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-4b805962-2697-4048-b288-8758cd088831 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:52.534803 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-4b805962-2697-4048-b288-8758cd088831 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1753 microversion: 2.20 time: 0.169652 Jun 17 08:54:52.535443 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 244/498] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:52 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:52.622881 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-032ae7a7-8d44-433e-972f-90da04f4110d req-ed00286b-e4a1-4835-aa50-45e5f99bb447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e32781c-7056-4c56-a02d-4c94cbc414f8", "name": "network-vif-plugged", "status": "completed", "tag": "3b983d08-82e5-4031-8c13-d190ca57fc87"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:54:52.631216 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-032ae7a7-8d44-433e-972f-90da04f4110d req-ed00286b-e4a1-4835-aa50-45e5f99bb447 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:52.633208 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-032ae7a7-8d44-433e-972f-90da04f4110d req-ed00286b-e4a1-4835-aa50-45e5f99bb447 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:52.637886 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-71a16275-62db-4fce-8663-6fa9d58a1a08 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:52.638500 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-71a16275-62db-4fce-8663-6fa9d58a1a08 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:52.644989 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-71a16275-62db-4fce-8663-6fa9d58a1a08 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:52.645550 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-71a16275-62db-4fce-8663-6fa9d58a1a08 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:52.646235 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-71a16275-62db-4fce-8663-6fa9d58a1a08 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:52.646643 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-71a16275-62db-4fce-8663-6fa9d58a1a08 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:52.648775 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-032ae7a7-8d44-433e-972f-90da04f4110d req-ed00286b-e4a1-4835-aa50-45e5f99bb447 service nova] Creating event network-vif-plugged:3b983d08-82e5-4031-8c13-d190ca57fc87 for instance 8e32781c-7056-4c56-a02d-4c94cbc414f8 on hv-cinder-79760 Jun 17 08:54:52.656086 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-032ae7a7-8d44-433e-972f-90da04f4110d req-ed00286b-e4a1-4835-aa50-45e5f99bb447 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035111 Jun 17 08:54:52.656086 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 255/499] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:54:52.853300 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-71a16275-62db-4fce-8663-6fa9d58a1a08 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:52.865907 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-71a16275-62db-4fce-8663-6fa9d58a1a08 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.231470 Jun 17 08:54:52.868774 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 245/500] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:52 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:53.048330 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-7c438b6b-0831-4c41-b813-1d3459627423 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:53.049534 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-7c438b6b-0831-4c41-b813-1d3459627423 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:53.058407 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7c438b6b-0831-4c41-b813-1d3459627423 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:53.059388 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7c438b6b-0831-4c41-b813-1d3459627423 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:53.060172 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7c438b6b-0831-4c41-b813-1d3459627423 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:53.060612 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7c438b6b-0831-4c41-b813-1d3459627423 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:53.196112 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-7c438b6b-0831-4c41-b813-1d3459627423 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:53.203511 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-7c438b6b-0831-4c41-b813-1d3459627423 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.160480 Jun 17 08:54:53.204074 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 256/501] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:53 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:53.550730 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-bd1a304b-49e0-49d6-a97e-9782c9a6d090 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:53.551397 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-bd1a304b-49e0-49d6-a97e-9782c9a6d090 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:53.559053 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bd1a304b-49e0-49d6-a97e-9782c9a6d090 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:53.559564 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bd1a304b-49e0-49d6-a97e-9782c9a6d090 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:53.560302 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bd1a304b-49e0-49d6-a97e-9782c9a6d090 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:53.560878 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bd1a304b-49e0-49d6-a97e-9782c9a6d090 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:53.733849 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-bd1a304b-49e0-49d6-a97e-9782c9a6d090 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:53.745847 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-bd1a304b-49e0-49d6-a97e-9782c9a6d090 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:53.747914 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-bd1a304b-49e0-49d6-a97e-9782c9a6d090 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:53.749862 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-bd1a304b-49e0-49d6-a97e-9782c9a6d090 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1753 microversion: 2.20 time: 0.202751 Jun 17 08:54:53.750627 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 246/502] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:53 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1753 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:53.887665 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-772b0cc7-6b7a-47f7-98be-cd31258b60ba tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:53.891688 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-772b0cc7-6b7a-47f7-98be-cd31258b60ba tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:53.896194 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-772b0cc7-6b7a-47f7-98be-cd31258b60ba tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:53.896654 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-772b0cc7-6b7a-47f7-98be-cd31258b60ba tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:53.897485 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-772b0cc7-6b7a-47f7-98be-cd31258b60ba tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:53.898315 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-772b0cc7-6b7a-47f7-98be-cd31258b60ba tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:54.074237 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-772b0cc7-6b7a-47f7-98be-cd31258b60ba tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:54.083939 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-772b0cc7-6b7a-47f7-98be-cd31258b60ba tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.202715 Jun 17 08:54:54.084511 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 257/503] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:53 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:54.222845 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-861856e6-28a3-4d24-ba95-18cf1b802ecd tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:54.223513 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-861856e6-28a3-4d24-ba95-18cf1b802ecd tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:54.230880 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-861856e6-28a3-4d24-ba95-18cf1b802ecd tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:54.231327 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-861856e6-28a3-4d24-ba95-18cf1b802ecd tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:54.232312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-861856e6-28a3-4d24-ba95-18cf1b802ecd tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:54.232746 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-861856e6-28a3-4d24-ba95-18cf1b802ecd tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:54.412622 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-861856e6-28a3-4d24-ba95-18cf1b802ecd tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:54.423107 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-861856e6-28a3-4d24-ba95-18cf1b802ecd tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.205931 Jun 17 08:54:54.424600 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 247/504] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:54 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:54.698643 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-fd273c1b-f620-4377-92ef-453eb045b26a tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "453aa64e-9de7-464f-8c8e-6870c2488c57"}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:54:54.700520 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-fd273c1b-f620-4377-92ef-453eb045b26a tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:54.707101 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fd273c1b-f620-4377-92ef-453eb045b26a tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:54.707810 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fd273c1b-f620-4377-92ef-453eb045b26a tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:54.708922 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fd273c1b-f620-4377-92ef-453eb045b26a tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:54.715137 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fd273c1b-f620-4377-92ef-453eb045b26a tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:54.771020 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-7b0fb7b4-bd98-4034-a751-63a39d8fad8d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:54.773054 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-7b0fb7b4-bd98-4034-a751-63a39d8fad8d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:54.779075 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7b0fb7b4-bd98-4034-a751-63a39d8fad8d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:54.779558 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7b0fb7b4-bd98-4034-a751-63a39d8fad8d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:54.780323 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7b0fb7b4-bd98-4034-a751-63a39d8fad8d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:54.780752 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7b0fb7b4-bd98-4034-a751-63a39d8fad8d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:54.941159 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-7b0fb7b4-bd98-4034-a751-63a39d8fad8d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:54.957836 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-7b0fb7b4-bd98-4034-a751-63a39d8fad8d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:54.962829 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-7b0fb7b4-bd98-4034-a751-63a39d8fad8d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:54.965509 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-7b0fb7b4-bd98-4034-a751-63a39d8fad8d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1753 microversion: 2.20 time: 0.200715 Jun 17 08:54:54.966503 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 248/505] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:54 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1753 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:54:55.100598 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-84594360-e706-4660-aa56-71779a93843b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:55.101619 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-84594360-e706-4660-aa56-71779a93843b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:55.110475 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-84594360-e706-4660-aa56-71779a93843b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:55.111011 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-84594360-e706-4660-aa56-71779a93843b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:55.115504 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-84594360-e706-4660-aa56-71779a93843b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:55.116987 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-84594360-e706-4660-aa56-71779a93843b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:55.299628 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-84594360-e706-4660-aa56-71779a93843b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:55.308936 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-84594360-e706-4660-aa56-71779a93843b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.211967 Jun 17 08:54:55.309590 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 249/506] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:55 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:55.442158 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-6cd039cb-66f7-48cd-9384-efb623b0e43a tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:55.442798 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-6cd039cb-66f7-48cd-9384-efb623b0e43a tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:55.450238 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6cd039cb-66f7-48cd-9384-efb623b0e43a tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:55.450828 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6cd039cb-66f7-48cd-9384-efb623b0e43a tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:55.451667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6cd039cb-66f7-48cd-9384-efb623b0e43a tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:55.452513 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6cd039cb-66f7-48cd-9384-efb623b0e43a tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:55.597483 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-6cd039cb-66f7-48cd-9384-efb623b0e43a tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:55.605270 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-6cd039cb-66f7-48cd-9384-efb623b0e43a tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1260 microversion: 2.1 time: 0.167098 Jun 17 08:54:55.605840 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 250/507] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:55 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:55.989771 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-4d34a6c7-e2f4-486c-beeb-670f34c04ba9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:55.990473 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-4d34a6c7-e2f4-486c-beeb-670f34c04ba9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:55.997464 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4d34a6c7-e2f4-486c-beeb-670f34c04ba9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:55.997908 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4d34a6c7-e2f4-486c-beeb-670f34c04ba9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:55.998670 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4d34a6c7-e2f4-486c-beeb-670f34c04ba9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:55.999101 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4d34a6c7-e2f4-486c-beeb-670f34c04ba9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:56.142238 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-4d34a6c7-e2f4-486c-beeb-670f34c04ba9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:56.158891 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-fd273c1b-f620-4377-92ef-453eb045b26a tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "POST /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.464691 Jun 17 08:54:56.161060 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 258/508] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jun 17 08:54:54 2022] POST /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d/os-volume_attachments => generated 194 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:54:56.166721 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-4d34a6c7-e2f4-486c-beeb-670f34c04ba9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:56.178105 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-4d34a6c7-e2f4-486c-beeb-670f34c04ba9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:56.181742 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-4d34a6c7-e2f4-486c-beeb-670f34c04ba9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1809 microversion: 2.20 time: 0.195023 Jun 17 08:54:56.182439 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 251/509] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:55 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:54:56.328132 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-db770877-ed16-43c2-8b79-61baeb483876 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:56.329033 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-db770877-ed16-43c2-8b79-61baeb483876 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:56.337493 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-db770877-ed16-43c2-8b79-61baeb483876 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:56.339001 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-db770877-ed16-43c2-8b79-61baeb483876 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:56.339001 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-db770877-ed16-43c2-8b79-61baeb483876 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:56.339729 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-db770877-ed16-43c2-8b79-61baeb483876 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:56.520135 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-db770877-ed16-43c2-8b79-61baeb483876 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:56.529246 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-db770877-ed16-43c2-8b79-61baeb483876 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.206896 Jun 17 08:54:56.529820 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 259/510] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:56 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:56.622831 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-8d1a04f9-4f4b-49fc-848e-d2cff5141e67 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:56.623391 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-8d1a04f9-4f4b-49fc-848e-d2cff5141e67 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:56.629842 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8d1a04f9-4f4b-49fc-848e-d2cff5141e67 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:56.630381 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8d1a04f9-4f4b-49fc-848e-d2cff5141e67 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:56.631240 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8d1a04f9-4f4b-49fc-848e-d2cff5141e67 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:56.631869 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8d1a04f9-4f4b-49fc-848e-d2cff5141e67 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:56.775898 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-8d1a04f9-4f4b-49fc-848e-d2cff5141e67 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:56.783699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-8d1a04f9-4f4b-49fc-848e-d2cff5141e67 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1445 microversion: 2.1 time: 0.164767 Jun 17 08:54:56.784594 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 252/511] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:56 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1445 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:56.801447 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-395763d9-f98a-4c50-a72d-50940f745d50 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:56.802061 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-395763d9-f98a-4c50-a72d-50940f745d50 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:56.809754 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-395763d9-f98a-4c50-a72d-50940f745d50 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:56.810216 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-395763d9-f98a-4c50-a72d-50940f745d50 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:56.810991 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-395763d9-f98a-4c50-a72d-50940f745d50 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:56.811454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-395763d9-f98a-4c50-a72d-50940f745d50 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:56.957460 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-395763d9-f98a-4c50-a72d-50940f745d50 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:56.966468 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-395763d9-f98a-4c50-a72d-50940f745d50 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1445 microversion: 2.1 time: 0.168793 Jun 17 08:54:56.966973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 260/512] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:56 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1445 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:54:57.201378 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-8959874b-7444-4c9c-a243-bc82c5518fd4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:57.202071 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-8959874b-7444-4c9c-a243-bc82c5518fd4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:57.208480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8959874b-7444-4c9c-a243-bc82c5518fd4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:57.208972 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8959874b-7444-4c9c-a243-bc82c5518fd4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:57.210363 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8959874b-7444-4c9c-a243-bc82c5518fd4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:57.211215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8959874b-7444-4c9c-a243-bc82c5518fd4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:57.384699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-8959874b-7444-4c9c-a243-bc82c5518fd4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:57.389708 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-8959874b-7444-4c9c-a243-bc82c5518fd4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:57.391245 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-8959874b-7444-4c9c-a243-bc82c5518fd4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:57.392471 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-8959874b-7444-4c9c-a243-bc82c5518fd4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1809 microversion: 2.20 time: 0.195617 Jun 17 08:54:57.393238 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 253/513] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:57 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:57.547250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-b9abdb22-fc60-4e7d-a652-94521a9f8250 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:57.548006 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-b9abdb22-fc60-4e7d-a652-94521a9f8250 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:57.554647 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b9abdb22-fc60-4e7d-a652-94521a9f8250 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:57.555100 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b9abdb22-fc60-4e7d-a652-94521a9f8250 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:57.555973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b9abdb22-fc60-4e7d-a652-94521a9f8250 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:57.556414 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b9abdb22-fc60-4e7d-a652-94521a9f8250 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:57.711240 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-b9abdb22-fc60-4e7d-a652-94521a9f8250 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:57.719434 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-b9abdb22-fc60-4e7d-a652-94521a9f8250 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.175946 Jun 17 08:54:57.720647 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 261/514] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:57 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:58.412050 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-211aee83-64a6-49cb-b7f3-84306c3d7149 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:58.412645 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-211aee83-64a6-49cb-b7f3-84306c3d7149 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:58.419922 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-211aee83-64a6-49cb-b7f3-84306c3d7149 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:58.420363 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-211aee83-64a6-49cb-b7f3-84306c3d7149 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:58.421130 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-211aee83-64a6-49cb-b7f3-84306c3d7149 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:58.421561 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-211aee83-64a6-49cb-b7f3-84306c3d7149 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:58.556989 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-211aee83-64a6-49cb-b7f3-84306c3d7149 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:58.566204 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-211aee83-64a6-49cb-b7f3-84306c3d7149 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:58.567726 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-211aee83-64a6-49cb-b7f3-84306c3d7149 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:58.568894 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-211aee83-64a6-49cb-b7f3-84306c3d7149 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1809 microversion: 2.20 time: 0.160927 Jun 17 08:54:58.569957 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 254/515] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:58 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:58.737538 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-00ddd06b-d385-46d3-8831-f26da9189daa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:58.738274 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-00ddd06b-d385-46d3-8831-f26da9189daa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:58.745695 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-00ddd06b-d385-46d3-8831-f26da9189daa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:58.746139 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-00ddd06b-d385-46d3-8831-f26da9189daa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:58.746906 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-00ddd06b-d385-46d3-8831-f26da9189daa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:58.747337 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-00ddd06b-d385-46d3-8831-f26da9189daa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:58.879854 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-00ddd06b-d385-46d3-8831-f26da9189daa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:58.888229 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-00ddd06b-d385-46d3-8831-f26da9189daa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.154505 Jun 17 08:54:58.889066 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 262/516] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:58 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:59.481986 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-8b6f12c2-6e1c-4f11-ab89-9151ff01fb8a req-65cff604-f715-4a27-b510-098a0950d80e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e32781c-7056-4c56-a02d-4c94cbc414f8", "tag": "3b983d08-82e5-4031-8c13-d190ca57fc87"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:54:59.490993 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-8b6f12c2-6e1c-4f11-ab89-9151ff01fb8a req-65cff604-f715-4a27-b510-098a0950d80e service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:59.491546 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-8b6f12c2-6e1c-4f11-ab89-9151ff01fb8a req-65cff604-f715-4a27-b510-098a0950d80e service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:59.502990 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-8b6f12c2-6e1c-4f11-ab89-9151ff01fb8a req-65cff604-f715-4a27-b510-098a0950d80e service nova] Creating event network-changed:3b983d08-82e5-4031-8c13-d190ca57fc87 for instance 8e32781c-7056-4c56-a02d-4c94cbc414f8 on hv-cinder-79760 Jun 17 08:54:59.509186 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-8b6f12c2-6e1c-4f11-ab89-9151ff01fb8a req-65cff604-f715-4a27-b510-098a0950d80e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030897 Jun 17 08:54:59.509726 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 255/517] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:54:59.589656 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-10a4d39c-c768-4652-90c2-95ca274468f2 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:59.590774 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-10a4d39c-c768-4652-90c2-95ca274468f2 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:59.597884 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-10a4d39c-c768-4652-90c2-95ca274468f2 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:59.598603 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-10a4d39c-c768-4652-90c2-95ca274468f2 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:59.600671 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-10a4d39c-c768-4652-90c2-95ca274468f2 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:59.601416 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-10a4d39c-c768-4652-90c2-95ca274468f2 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:59.783670 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-10a4d39c-c768-4652-90c2-95ca274468f2 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:59.795272 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-10a4d39c-c768-4652-90c2-95ca274468f2 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:59.797015 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-10a4d39c-c768-4652-90c2-95ca274468f2 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:59.798939 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-10a4d39c-c768-4652-90c2-95ca274468f2 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1809 microversion: 2.20 time: 0.215015 Jun 17 08:54:59.811205 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 263/518] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:54:59 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1809 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:54:59.906749 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-2dcc8f17-93c4-4379-91c8-acb373aa4c4e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:59.907754 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-2dcc8f17-93c4-4379-91c8-acb373aa4c4e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:59.915769 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2dcc8f17-93c4-4379-91c8-acb373aa4c4e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:59.916509 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2dcc8f17-93c4-4379-91c8-acb373aa4c4e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:59.917560 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2dcc8f17-93c4-4379-91c8-acb373aa4c4e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:59.918174 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2dcc8f17-93c4-4379-91c8-acb373aa4c4e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:00.106975 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2dcc8f17-93c4-4379-91c8-acb373aa4c4e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:00.127819 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-2dcc8f17-93c4-4379-91c8-acb373aa4c4e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.213573 Jun 17 08:55:00.127819 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 256/519] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:59 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:00.818695 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-ecd26ffe-4d58-4327-b804-70053954184f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:00.820793 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-ecd26ffe-4d58-4327-b804-70053954184f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:00.827930 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ecd26ffe-4d58-4327-b804-70053954184f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:00.828658 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ecd26ffe-4d58-4327-b804-70053954184f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:00.829683 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ecd26ffe-4d58-4327-b804-70053954184f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:00.830328 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ecd26ffe-4d58-4327-b804-70053954184f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:00.892612 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-ee52db05-285b-4f47-94f4-7503f189b8ca tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-401740635", "imageRef": "978084c7-ed2c-4e42-ac8b-f5d19c4001fe", "flavorRef": "452", "networks": [{"uuid": "ba4c2740-eda9-41f4-b954-e1d4f9107a41"}]}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:55:00.978275 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.network.neutron [None req-ee52db05-285b-4f47-94f4-7503f189b8ca tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] validate_networks() for [('ba4c2740-eda9-41f4-b954-e1d4f9107a41', None, None, None, None, None)] {{(pid=129875) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:55:01.122075 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-ecd26ffe-4d58-4327-b804-70053954184f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:01.134414 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-ecd26ffe-4d58-4327-b804-70053954184f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:01.136207 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-ecd26ffe-4d58-4327-b804-70053954184f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:01.137455 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-ecd26ffe-4d58-4327-b804-70053954184f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1809 microversion: 2.20 time: 0.323010 Jun 17 08:55:01.138359 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 264/520] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:55:00 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1809 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:55:01.143706 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-072a09d9-bafd-4f63-a81a-0e78676ebb80 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:01.144674 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-072a09d9-bafd-4f63-a81a-0e78676ebb80 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:01.153746 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-072a09d9-bafd-4f63-a81a-0e78676ebb80 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:01.154794 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-072a09d9-bafd-4f63-a81a-0e78676ebb80 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:01.155863 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-072a09d9-bafd-4f63-a81a-0e78676ebb80 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:01.156489 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-072a09d9-bafd-4f63-a81a-0e78676ebb80 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:01.205270 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=2 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:01.378655 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-072a09d9-bafd-4f63-a81a-0e78676ebb80 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:01.386965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-072a09d9-bafd-4f63-a81a-0e78676ebb80 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.247048 Jun 17 08:55:01.387528 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 265/521] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:01 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:01.641844 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-ee52db05-285b-4f47-94f4-7503f189b8ca tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Flavor limits 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:55:01.642385 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-ee52db05-285b-4f47-94f4-7503f189b8ca tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Image limits 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:55:01.642940 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-ee52db05-285b-4f47-94f4-7503f189b8ca tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Flavor pref 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:55:01.643456 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-ee52db05-285b-4f47-94f4-7503f189b8ca tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Image pref 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:55:01.644261 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-ee52db05-285b-4f47-94f4-7503f189b8ca tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:55:01.661874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ee52db05-285b-4f47-94f4-7503f189b8ca tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:01.664778 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ee52db05-285b-4f47-94f4-7503f189b8ca tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:01.664778 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ee52db05-285b-4f47-94f4-7503f189b8ca tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:01.664778 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ee52db05-285b-4f47-94f4-7503f189b8ca tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:01.672197 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=100 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:01.686514 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-ee52db05-285b-4f47-94f4-7503f189b8ca tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Getting quotas for project 25f8de28a0664821af43d9cdccab292d. Resources: {'ram', 'cores', 'instances'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:55:01.691112 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-ee52db05-285b-4f47-94f4-7503f189b8ca tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Getting quotas for user f571731515754890874b862a1407ebc0 and project 25f8de28a0664821af43d9cdccab292d. Resources: {'ram', 'cores', 'instances'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:55:01.706937 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-ee52db05-285b-4f47-94f4-7503f189b8ca tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Going to run 1 instances... {{(pid=129875) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:55:01.709264 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-ee52db05-285b-4f47-94f4-7503f189b8ca tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='978084c7-ed2c-4e42-ac8b-f5d19c4001fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:55:01.857184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-ee52db05-285b-4f47-94f4-7503f189b8ca tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.968151 Jun 17 08:55:01.858501 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 257/522] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jun 17 08:55:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:55:01.872597 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-25008a0a-f135-4309-9952-31ec911a4f7e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:01.877918 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-25008a0a-f135-4309-9952-31ec911a4f7e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:01.953160 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-25008a0a-f135-4309-9952-31ec911a4f7e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:01.962635 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-25008a0a-f135-4309-9952-31ec911a4f7e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1218 microversion: 2.1 time: 0.094073 Jun 17 08:55:01.964626 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 266/523] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:01 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:02.158524 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0ae5b24b-aa4f-46fb-b4d1-dac3f140fd48 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:02.159913 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0ae5b24b-aa4f-46fb-b4d1-dac3f140fd48 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:02.167852 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0ae5b24b-aa4f-46fb-b4d1-dac3f140fd48 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:02.168806 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0ae5b24b-aa4f-46fb-b4d1-dac3f140fd48 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:02.169839 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0ae5b24b-aa4f-46fb-b4d1-dac3f140fd48 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:02.170814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0ae5b24b-aa4f-46fb-b4d1-dac3f140fd48 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:02.342591 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0ae5b24b-aa4f-46fb-b4d1-dac3f140fd48 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:02.352907 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0ae5b24b-aa4f-46fb-b4d1-dac3f140fd48 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:02.354846 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0ae5b24b-aa4f-46fb-b4d1-dac3f140fd48 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:02.356712 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0ae5b24b-aa4f-46fb-b4d1-dac3f140fd48 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1809 microversion: 2.20 time: 0.202874 Jun 17 08:55:02.357538 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 258/524] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:55:02 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:55:02.408925 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-aadd9df3-31b7-4b50-b18f-1888b9353590 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:02.409916 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-aadd9df3-31b7-4b50-b18f-1888b9353590 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:02.417675 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-aadd9df3-31b7-4b50-b18f-1888b9353590 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:02.424381 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-aadd9df3-31b7-4b50-b18f-1888b9353590 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:02.424381 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-aadd9df3-31b7-4b50-b18f-1888b9353590 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:02.424381 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-aadd9df3-31b7-4b50-b18f-1888b9353590 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:02.575156 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-aadd9df3-31b7-4b50-b18f-1888b9353590 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:02.583695 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-aadd9df3-31b7-4b50-b18f-1888b9353590 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.181175 Jun 17 08:55:02.585017 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 267/525] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:02 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:02.982681 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-e7903309-0b18-4544-9ba5-56df0e191e84 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:02.983547 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-e7903309-0b18-4544-9ba5-56df0e191e84 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:03.039711 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-e7903309-0b18-4544-9ba5-56df0e191e84 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:03.046651 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-e7903309-0b18-4544-9ba5-56df0e191e84 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1218 microversion: 2.1 time: 0.067852 Jun 17 08:55:03.050348 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 259/526] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:02 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:03.376411 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-94e5a2ab-0949-4efa-9ac3-1720cef102cb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:03.377049 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-94e5a2ab-0949-4efa-9ac3-1720cef102cb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:03.384053 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-94e5a2ab-0949-4efa-9ac3-1720cef102cb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:03.384432 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-94e5a2ab-0949-4efa-9ac3-1720cef102cb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:03.385210 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-94e5a2ab-0949-4efa-9ac3-1720cef102cb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:03.385653 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-94e5a2ab-0949-4efa-9ac3-1720cef102cb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:03.389026 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:03.534515 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-94e5a2ab-0949-4efa-9ac3-1720cef102cb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:03.544584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-94e5a2ab-0949-4efa-9ac3-1720cef102cb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:03.546090 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-94e5a2ab-0949-4efa-9ac3-1720cef102cb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:03.547261 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-94e5a2ab-0949-4efa-9ac3-1720cef102cb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1809 microversion: 2.20 time: 0.174814 Jun 17 08:55:03.547855 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 268/527] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:55:03 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:55:03.601807 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3f8bab9a-7067-4075-8cd6-1ef8a212cd87 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:03.602480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-3f8bab9a-7067-4075-8cd6-1ef8a212cd87 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:03.608988 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3f8bab9a-7067-4075-8cd6-1ef8a212cd87 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:03.609439 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3f8bab9a-7067-4075-8cd6-1ef8a212cd87 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:03.610421 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3f8bab9a-7067-4075-8cd6-1ef8a212cd87 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:03.610857 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3f8bab9a-7067-4075-8cd6-1ef8a212cd87 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:03.764511 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3f8bab9a-7067-4075-8cd6-1ef8a212cd87 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:03.773046 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-3f8bab9a-7067-4075-8cd6-1ef8a212cd87 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.175284 Jun 17 08:55:03.773633 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 260/528] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:03 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:04.064982 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-d16a2c38-2de6-48e7-bdd7-895458869687 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:04.065602 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-d16a2c38-2de6-48e7-bdd7-895458869687 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:04.073316 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d16a2c38-2de6-48e7-bdd7-895458869687 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:04.073776 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d16a2c38-2de6-48e7-bdd7-895458869687 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:04.074563 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d16a2c38-2de6-48e7-bdd7-895458869687 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:04.075027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d16a2c38-2de6-48e7-bdd7-895458869687 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:04.142649 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-d16a2c38-2de6-48e7-bdd7-895458869687 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:04.151314 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-d16a2c38-2de6-48e7-bdd7-895458869687 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1222 microversion: 2.1 time: 0.090324 Jun 17 08:55:04.151943 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 269/529] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:04 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:55:04.570483 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3e7ca696-ef6a-49f7-ac61-f7db3ef02b72 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:04.571087 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-3e7ca696-ef6a-49f7-ac61-f7db3ef02b72 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:04.577855 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3e7ca696-ef6a-49f7-ac61-f7db3ef02b72 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:04.578239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3e7ca696-ef6a-49f7-ac61-f7db3ef02b72 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:04.579022 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3e7ca696-ef6a-49f7-ac61-f7db3ef02b72 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:04.579491 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3e7ca696-ef6a-49f7-ac61-f7db3ef02b72 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:04.725788 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3e7ca696-ef6a-49f7-ac61-f7db3ef02b72 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:04.732184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3e7ca696-ef6a-49f7-ac61-f7db3ef02b72 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:04.733721 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3e7ca696-ef6a-49f7-ac61-f7db3ef02b72 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:04.734915 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-3e7ca696-ef6a-49f7-ac61-f7db3ef02b72 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1809 microversion: 2.20 time: 0.168684 Jun 17 08:55:04.735506 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 261/530] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:55:04 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:55:04.790811 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-80fc6056-af59-4360-b872-d642896bcbf1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:04.791920 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-80fc6056-af59-4360-b872-d642896bcbf1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:04.799205 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-80fc6056-af59-4360-b872-d642896bcbf1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:04.799769 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-80fc6056-af59-4360-b872-d642896bcbf1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:04.800539 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-80fc6056-af59-4360-b872-d642896bcbf1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:04.800982 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-80fc6056-af59-4360-b872-d642896bcbf1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:04.968438 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-80fc6056-af59-4360-b872-d642896bcbf1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:04.978590 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-80fc6056-af59-4360-b872-d642896bcbf1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.192333 Jun 17 08:55:04.979922 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 270/531] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:04 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:05.169235 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-9d45c549-16b1-4a46-abcc-5b499caa1023 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:05.169899 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-9d45c549-16b1-4a46-abcc-5b499caa1023 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:05.176428 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9d45c549-16b1-4a46-abcc-5b499caa1023 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:05.176875 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9d45c549-16b1-4a46-abcc-5b499caa1023 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:05.177670 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9d45c549-16b1-4a46-abcc-5b499caa1023 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:05.178289 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9d45c549-16b1-4a46-abcc-5b499caa1023 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:05.248673 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-9d45c549-16b1-4a46-abcc-5b499caa1023 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:05.257288 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-9d45c549-16b1-4a46-abcc-5b499caa1023 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1222 microversion: 2.1 time: 0.091806 Jun 17 08:55:05.257893 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 262/532] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:05 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:05.754092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-7caa8a2c-4d81-448c-aae5-e021d31f62e6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:05.754857 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-7caa8a2c-4d81-448c-aae5-e021d31f62e6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:05.761631 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7caa8a2c-4d81-448c-aae5-e021d31f62e6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:05.762137 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7caa8a2c-4d81-448c-aae5-e021d31f62e6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:05.763140 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7caa8a2c-4d81-448c-aae5-e021d31f62e6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:05.763826 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7caa8a2c-4d81-448c-aae5-e021d31f62e6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:05.901870 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-7caa8a2c-4d81-448c-aae5-e021d31f62e6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:05.911000 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-7caa8a2c-4d81-448c-aae5-e021d31f62e6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:05.913224 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-7caa8a2c-4d81-448c-aae5-e021d31f62e6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:05.914703 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-7caa8a2c-4d81-448c-aae5-e021d31f62e6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1809 microversion: 2.20 time: 0.164527 Jun 17 08:55:05.915439 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 271/533] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:55:05 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:55:05.996569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-b6a9b5c1-47d8-4ebd-91ed-7eba34f20166 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:05.997446 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-b6a9b5c1-47d8-4ebd-91ed-7eba34f20166 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:06.005845 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b6a9b5c1-47d8-4ebd-91ed-7eba34f20166 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:06.006877 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b6a9b5c1-47d8-4ebd-91ed-7eba34f20166 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:06.008021 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b6a9b5c1-47d8-4ebd-91ed-7eba34f20166 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:06.008453 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b6a9b5c1-47d8-4ebd-91ed-7eba34f20166 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:06.149955 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b6a9b5c1-47d8-4ebd-91ed-7eba34f20166 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:06.157673 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-b6a9b5c1-47d8-4ebd-91ed-7eba34f20166 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.164837 Jun 17 08:55:06.165706 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 263/534] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:05 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:06.274772 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-be83a434-4c3c-47a6-a7c8-64cae25cd3c5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:06.275442 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-be83a434-4c3c-47a6-a7c8-64cae25cd3c5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:06.281890 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-be83a434-4c3c-47a6-a7c8-64cae25cd3c5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:06.282437 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-be83a434-4c3c-47a6-a7c8-64cae25cd3c5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:06.283631 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-be83a434-4c3c-47a6-a7c8-64cae25cd3c5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:06.283747 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-be83a434-4c3c-47a6-a7c8-64cae25cd3c5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:06.353665 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-be83a434-4c3c-47a6-a7c8-64cae25cd3c5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:06.361877 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-be83a434-4c3c-47a6-a7c8-64cae25cd3c5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1222 microversion: 2.1 time: 0.091502 Jun 17 08:55:06.362461 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 272/535] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:06 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:06.934410 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-c077be95-818f-4ddc-8fa7-380e388ca304 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:06.935026 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-c077be95-818f-4ddc-8fa7-380e388ca304 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:06.942584 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c077be95-818f-4ddc-8fa7-380e388ca304 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:06.943034 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c077be95-818f-4ddc-8fa7-380e388ca304 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:06.944503 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c077be95-818f-4ddc-8fa7-380e388ca304 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:06.944503 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c077be95-818f-4ddc-8fa7-380e388ca304 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:07.083377 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c077be95-818f-4ddc-8fa7-380e388ca304 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:07.093663 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c077be95-818f-4ddc-8fa7-380e388ca304 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:07.095168 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c077be95-818f-4ddc-8fa7-380e388ca304 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:07.096359 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-c077be95-818f-4ddc-8fa7-380e388ca304 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1809 microversion: 2.20 time: 0.166376 Jun 17 08:55:07.096914 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 264/536] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:55:06 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:55:07.175270 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-19062dc8-c06c-42d0-808a-e8885171ef87 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:07.175892 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-19062dc8-c06c-42d0-808a-e8885171ef87 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:07.182726 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-19062dc8-c06c-42d0-808a-e8885171ef87 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:07.183175 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-19062dc8-c06c-42d0-808a-e8885171ef87 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:07.184237 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-19062dc8-c06c-42d0-808a-e8885171ef87 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:07.184704 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-19062dc8-c06c-42d0-808a-e8885171ef87 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:07.322556 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-19062dc8-c06c-42d0-808a-e8885171ef87 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:07.330569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-19062dc8-c06c-42d0-808a-e8885171ef87 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.159101 Jun 17 08:55:07.331584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 273/537] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:07 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:07.379568 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-fd123ce6-fa8f-46c7-9ff9-56dadf856c4f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:07.380282 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-fd123ce6-fa8f-46c7-9ff9-56dadf856c4f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:07.390992 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fd123ce6-fa8f-46c7-9ff9-56dadf856c4f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:07.394471 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fd123ce6-fa8f-46c7-9ff9-56dadf856c4f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:07.394471 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fd123ce6-fa8f-46c7-9ff9-56dadf856c4f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:07.394471 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fd123ce6-fa8f-46c7-9ff9-56dadf856c4f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:07.468950 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-fd123ce6-fa8f-46c7-9ff9-56dadf856c4f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:07.477113 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-fd123ce6-fa8f-46c7-9ff9-56dadf856c4f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1222 microversion: 2.1 time: 0.101525 Jun 17 08:55:07.477916 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 265/538] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:07 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:08.115447 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-d5986dba-eb4d-48af-978c-0b1471573d42 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:08.116682 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-d5986dba-eb4d-48af-978c-0b1471573d42 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:08.123176 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d5986dba-eb4d-48af-978c-0b1471573d42 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:08.123657 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d5986dba-eb4d-48af-978c-0b1471573d42 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:08.124484 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d5986dba-eb4d-48af-978c-0b1471573d42 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:08.124887 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d5986dba-eb4d-48af-978c-0b1471573d42 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:08.264116 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-d5986dba-eb4d-48af-978c-0b1471573d42 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:08.273450 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-d5986dba-eb4d-48af-978c-0b1471573d42 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:08.274956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-d5986dba-eb4d-48af-978c-0b1471573d42 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:08.276397 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-d5986dba-eb4d-48af-978c-0b1471573d42 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1809 microversion: 2.20 time: 0.165301 Jun 17 08:55:08.277150 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 274/539] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:55:08 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:55:08.354330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-747d151f-75b4-4fe5-9739-3acaa0cdcc4b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:08.354917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-747d151f-75b4-4fe5-9739-3acaa0cdcc4b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:08.361714 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-747d151f-75b4-4fe5-9739-3acaa0cdcc4b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:08.362166 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-747d151f-75b4-4fe5-9739-3acaa0cdcc4b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:08.362942 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-747d151f-75b4-4fe5-9739-3acaa0cdcc4b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:08.363399 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-747d151f-75b4-4fe5-9739-3acaa0cdcc4b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:08.497583 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-d1664356-a392-4009-8ce4-f0005e2d26aa tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:08.501955 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-d1664356-a392-4009-8ce4-f0005e2d26aa tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:08.509956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d1664356-a392-4009-8ce4-f0005e2d26aa tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:08.510434 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d1664356-a392-4009-8ce4-f0005e2d26aa tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:08.512034 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d1664356-a392-4009-8ce4-f0005e2d26aa tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:08.512574 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d1664356-a392-4009-8ce4-f0005e2d26aa tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:08.523548 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-747d151f-75b4-4fe5-9739-3acaa0cdcc4b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:08.532163 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-747d151f-75b4-4fe5-9739-3acaa0cdcc4b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.182697 Jun 17 08:55:08.532652 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 266/540] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:08 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:08.590338 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-d1664356-a392-4009-8ce4-f0005e2d26aa tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:08.597920 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-d1664356-a392-4009-8ce4-f0005e2d26aa tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1222 microversion: 2.1 time: 0.106115 Jun 17 08:55:08.598489 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 275/541] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:08 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1222 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:09.295178 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-b226e657-7a02-47ee-ae85-a599d777b177 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:09.295779 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-b226e657-7a02-47ee-ae85-a599d777b177 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:09.302210 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b226e657-7a02-47ee-ae85-a599d777b177 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:09.302659 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b226e657-7a02-47ee-ae85-a599d777b177 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:09.303612 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b226e657-7a02-47ee-ae85-a599d777b177 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:09.304049 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b226e657-7a02-47ee-ae85-a599d777b177 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:09.449238 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b226e657-7a02-47ee-ae85-a599d777b177 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:09.458071 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b226e657-7a02-47ee-ae85-a599d777b177 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:09.460318 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b226e657-7a02-47ee-ae85-a599d777b177 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:09.461489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-b226e657-7a02-47ee-ae85-a599d777b177 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1809 microversion: 2.20 time: 0.170339 Jun 17 08:55:09.462091 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 267/542] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:55:09 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:55:09.554855 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-67a03eea-299b-40ee-8d3d-765bb47b4d68 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:09.554855 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-67a03eea-299b-40ee-8d3d-765bb47b4d68 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:09.559237 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-67a03eea-299b-40ee-8d3d-765bb47b4d68 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:09.559746 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-67a03eea-299b-40ee-8d3d-765bb47b4d68 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:09.560740 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-67a03eea-299b-40ee-8d3d-765bb47b4d68 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:09.561215 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-67a03eea-299b-40ee-8d3d-765bb47b4d68 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:09.615868 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-6ce556bf-8025-432e-90b6-38cde868364d tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:09.616269 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-6ce556bf-8025-432e-90b6-38cde868364d tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:09.622523 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6ce556bf-8025-432e-90b6-38cde868364d tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:09.622980 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6ce556bf-8025-432e-90b6-38cde868364d tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:09.623974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6ce556bf-8025-432e-90b6-38cde868364d tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:09.624840 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6ce556bf-8025-432e-90b6-38cde868364d tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:09.713454 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-6ce556bf-8025-432e-90b6-38cde868364d tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:09.722214 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-6ce556bf-8025-432e-90b6-38cde868364d tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1222 microversion: 2.1 time: 0.110234 Jun 17 08:55:09.728204 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 268/543] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:09 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1222 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:55:09.737306 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-67a03eea-299b-40ee-8d3d-765bb47b4d68 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:09.745307 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-67a03eea-299b-40ee-8d3d-765bb47b4d68 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.199280 Jun 17 08:55:09.745894 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 276/544] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:09 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:10.487418 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-20a2a507-d5c8-41dc-b420-bd743bbb5b6d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:10.491611 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-20a2a507-d5c8-41dc-b420-bd743bbb5b6d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:10.498774 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-20a2a507-d5c8-41dc-b420-bd743bbb5b6d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:10.499217 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-20a2a507-d5c8-41dc-b420-bd743bbb5b6d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:10.500137 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-20a2a507-d5c8-41dc-b420-bd743bbb5b6d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:10.500562 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-20a2a507-d5c8-41dc-b420-bd743bbb5b6d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:10.740313 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-6a7d4948-ace6-44e0-a7a5-a5ec93723368 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:10.741567 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-6a7d4948-ace6-44e0-a7a5-a5ec93723368 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:10.748950 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6a7d4948-ace6-44e0-a7a5-a5ec93723368 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:10.749435 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6a7d4948-ace6-44e0-a7a5-a5ec93723368 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:10.750213 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6a7d4948-ace6-44e0-a7a5-a5ec93723368 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:10.750655 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6a7d4948-ace6-44e0-a7a5-a5ec93723368 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:10.867938 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-6a7d4948-ace6-44e0-a7a5-a5ec93723368 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:10.879043 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-6a7d4948-ace6-44e0-a7a5-a5ec93723368 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1222 microversion: 2.1 time: 0.142618 Jun 17 08:55:10.882720 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 277/545] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:10 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1222 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:10.886760 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-4cb5b27d-111a-4c6f-af7f-0e3cc72f78eb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:10.887579 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-4cb5b27d-111a-4c6f-af7f-0e3cc72f78eb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:10.909137 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4cb5b27d-111a-4c6f-af7f-0e3cc72f78eb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:10.910394 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4cb5b27d-111a-4c6f-af7f-0e3cc72f78eb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:10.911484 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4cb5b27d-111a-4c6f-af7f-0e3cc72f78eb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:10.912151 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4cb5b27d-111a-4c6f-af7f-0e3cc72f78eb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:10.955906 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-20a2a507-d5c8-41dc-b420-bd743bbb5b6d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:10.975825 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-20a2a507-d5c8-41dc-b420-bd743bbb5b6d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:10.977805 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-20a2a507-d5c8-41dc-b420-bd743bbb5b6d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:10.979088 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-20a2a507-d5c8-41dc-b420-bd743bbb5b6d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1809 microversion: 2.20 time: 0.502856 Jun 17 08:55:10.979937 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 269/546] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:55:10 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1809 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:55:11.080665 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-4cb5b27d-111a-4c6f-af7f-0e3cc72f78eb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:11.089430 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-4cb5b27d-111a-4c6f-af7f-0e3cc72f78eb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.207778 Jun 17 08:55:11.090031 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 278/547] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:10 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:11.898464 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1bd19c2c-2bd5-4b9b-a21b-2aee491d034f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:11.899074 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-1bd19c2c-2bd5-4b9b-a21b-2aee491d034f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:11.901476 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=2 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:11.906359 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1bd19c2c-2bd5-4b9b-a21b-2aee491d034f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:11.906807 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1bd19c2c-2bd5-4b9b-a21b-2aee491d034f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:11.907590 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1bd19c2c-2bd5-4b9b-a21b-2aee491d034f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:11.908023 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1bd19c2c-2bd5-4b9b-a21b-2aee491d034f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:11.972326 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-1bd19c2c-2bd5-4b9b-a21b-2aee491d034f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:11.979674 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-1bd19c2c-2bd5-4b9b-a21b-2aee491d034f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1222 microversion: 2.1 time: 0.085513 Jun 17 08:55:11.980239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 270/548] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:11 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:12.000731 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-4ddd9f35-78c7-4003-b398-5587d005d9d3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:12.001328 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-4ddd9f35-78c7-4003-b398-5587d005d9d3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:12.003717 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=2 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:12.009379 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4ddd9f35-78c7-4003-b398-5587d005d9d3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:12.010548 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4ddd9f35-78c7-4003-b398-5587d005d9d3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:12.010676 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4ddd9f35-78c7-4003-b398-5587d005d9d3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:12.011085 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4ddd9f35-78c7-4003-b398-5587d005d9d3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:12.109858 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-dd25f3bb-3897-4ed3-914b-9e9644076d0a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:12.110757 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-dd25f3bb-3897-4ed3-914b-9e9644076d0a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:12.117035 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-dd25f3bb-3897-4ed3-914b-9e9644076d0a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:12.117487 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-dd25f3bb-3897-4ed3-914b-9e9644076d0a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:12.118485 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-dd25f3bb-3897-4ed3-914b-9e9644076d0a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:12.118921 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-dd25f3bb-3897-4ed3-914b-9e9644076d0a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:12.151409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-4ddd9f35-78c7-4003-b398-5587d005d9d3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:12.161398 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-4ddd9f35-78c7-4003-b398-5587d005d9d3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:12.166091 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-4ddd9f35-78c7-4003-b398-5587d005d9d3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:12.166091 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-4ddd9f35-78c7-4003-b398-5587d005d9d3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1809 microversion: 2.20 time: 0.168174 Jun 17 08:55:12.166091 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 279/549] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:55:11 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:55:12.261883 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-dd25f3bb-3897-4ed3-914b-9e9644076d0a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:12.269657 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-dd25f3bb-3897-4ed3-914b-9e9644076d0a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.163626 Jun 17 08:55:12.270239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 271/550] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:12 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:55:12.997901 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-5416c0ac-64cd-4dd2-a876-a06cdbb8dba3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:12.998518 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-5416c0ac-64cd-4dd2-a876-a06cdbb8dba3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:13.005329 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5416c0ac-64cd-4dd2-a876-a06cdbb8dba3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:13.005968 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5416c0ac-64cd-4dd2-a876-a06cdbb8dba3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:13.006615 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5416c0ac-64cd-4dd2-a876-a06cdbb8dba3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:13.007318 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5416c0ac-64cd-4dd2-a876-a06cdbb8dba3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:13.070847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-5416c0ac-64cd-4dd2-a876-a06cdbb8dba3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:13.078351 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-5416c0ac-64cd-4dd2-a876-a06cdbb8dba3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1222 microversion: 2.1 time: 0.084574 Jun 17 08:55:13.078903 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 280/551] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:12 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:13.183923 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-2bad3f04-4e04-4fa1-8593-85a8f9c52d3e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:13.184476 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-2bad3f04-4e04-4fa1-8593-85a8f9c52d3e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:13.186779 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=8 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:13.187475 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:13.192251 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2bad3f04-4e04-4fa1-8593-85a8f9c52d3e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:13.192702 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2bad3f04-4e04-4fa1-8593-85a8f9c52d3e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:13.193498 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2bad3f04-4e04-4fa1-8593-85a8f9c52d3e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:13.194051 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2bad3f04-4e04-4fa1-8593-85a8f9c52d3e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:13.287337 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-c96210e4-1f67-46f5-9140-00dcd5508d82 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:13.288760 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-c96210e4-1f67-46f5-9140-00dcd5508d82 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:13.294774 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c96210e4-1f67-46f5-9140-00dcd5508d82 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:13.295228 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c96210e4-1f67-46f5-9140-00dcd5508d82 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:13.296036 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c96210e4-1f67-46f5-9140-00dcd5508d82 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:13.296473 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c96210e4-1f67-46f5-9140-00dcd5508d82 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:13.351804 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2bad3f04-4e04-4fa1-8593-85a8f9c52d3e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:13.360173 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2bad3f04-4e04-4fa1-8593-85a8f9c52d3e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:13.361656 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2bad3f04-4e04-4fa1-8593-85a8f9c52d3e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:13.362828 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-2bad3f04-4e04-4fa1-8593-85a8f9c52d3e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1809 microversion: 2.20 time: 0.183186 Jun 17 08:55:13.363397 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 272/552] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:55:13 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:55:13.439702 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c96210e4-1f67-46f5-9140-00dcd5508d82 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:13.448442 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-c96210e4-1f67-46f5-9140-00dcd5508d82 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.164707 Jun 17 08:55:13.449042 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 281/553] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:13 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:14.096700 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-59c10ebc-deaf-4da4-b2aa-d88129601f0f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:14.097346 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-59c10ebc-deaf-4da4-b2aa-d88129601f0f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:14.104907 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-59c10ebc-deaf-4da4-b2aa-d88129601f0f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:14.105353 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-59c10ebc-deaf-4da4-b2aa-d88129601f0f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:14.106115 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-59c10ebc-deaf-4da4-b2aa-d88129601f0f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:14.106547 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-59c10ebc-deaf-4da4-b2aa-d88129601f0f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:14.169943 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-59c10ebc-deaf-4da4-b2aa-d88129601f0f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:14.181359 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-59c10ebc-deaf-4da4-b2aa-d88129601f0f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1270 microversion: 2.1 time: 0.088727 Jun 17 08:55:14.181987 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 273/554] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:14 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:14.380610 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-76334f0f-c95e-41ed-9072-204151540beb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:14.381196 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-76334f0f-c95e-41ed-9072-204151540beb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:14.388287 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-76334f0f-c95e-41ed-9072-204151540beb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:14.388861 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-76334f0f-c95e-41ed-9072-204151540beb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:14.389816 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-76334f0f-c95e-41ed-9072-204151540beb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:14.390254 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-76334f0f-c95e-41ed-9072-204151540beb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:14.466540 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-feab3ab7-4395-41e5-9768-7dd60932a3fa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:14.473332 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-feab3ab7-4395-41e5-9768-7dd60932a3fa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:14.476526 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-feab3ab7-4395-41e5-9768-7dd60932a3fa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:14.476979 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-feab3ab7-4395-41e5-9768-7dd60932a3fa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:14.477762 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-feab3ab7-4395-41e5-9768-7dd60932a3fa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:14.478259 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-feab3ab7-4395-41e5-9768-7dd60932a3fa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:14.597342 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-76334f0f-c95e-41ed-9072-204151540beb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:14.609310 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-76334f0f-c95e-41ed-9072-204151540beb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:14.618830 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-76334f0f-c95e-41ed-9072-204151540beb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:14.618830 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-76334f0f-c95e-41ed-9072-204151540beb tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1809 microversion: 2.20 time: 0.235900 Jun 17 08:55:14.618830 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 282/555] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:55:14 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1809 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:55:14.642523 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-feab3ab7-4395-41e5-9768-7dd60932a3fa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:14.650612 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-feab3ab7-4395-41e5-9768-7dd60932a3fa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.189312 Jun 17 08:55:14.651173 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 274/556] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:14 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:15.198217 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-01115c7e-b95a-4bb3-9031-41a43edc1975 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:15.198830 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-01115c7e-b95a-4bb3-9031-41a43edc1975 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:15.204983 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-01115c7e-b95a-4bb3-9031-41a43edc1975 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:15.208155 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-01115c7e-b95a-4bb3-9031-41a43edc1975 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:15.208155 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-01115c7e-b95a-4bb3-9031-41a43edc1975 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:15.208155 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-01115c7e-b95a-4bb3-9031-41a43edc1975 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:15.268259 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-01115c7e-b95a-4bb3-9031-41a43edc1975 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:15.276089 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-01115c7e-b95a-4bb3-9031-41a43edc1975 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1270 microversion: 2.1 time: 0.081776 Jun 17 08:55:15.276648 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 283/557] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:15 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1270 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:15.630082 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-50cef5b7-8f5b-4ba2-a003-c5653e1cd285 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:15.630669 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-50cef5b7-8f5b-4ba2-a003-c5653e1cd285 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:15.637305 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-50cef5b7-8f5b-4ba2-a003-c5653e1cd285 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:15.640125 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-50cef5b7-8f5b-4ba2-a003-c5653e1cd285 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:15.640125 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-50cef5b7-8f5b-4ba2-a003-c5653e1cd285 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:15.640125 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-50cef5b7-8f5b-4ba2-a003-c5653e1cd285 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:15.657236 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=100 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:15.673891 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-bfc4dcc2-2c5d-4a1c-af60-006d426f4702 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:15.674574 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-bfc4dcc2-2c5d-4a1c-af60-006d426f4702 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:15.691555 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bfc4dcc2-2c5d-4a1c-af60-006d426f4702 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:15.692012 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bfc4dcc2-2c5d-4a1c-af60-006d426f4702 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:15.694642 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bfc4dcc2-2c5d-4a1c-af60-006d426f4702 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:15.694926 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bfc4dcc2-2c5d-4a1c-af60-006d426f4702 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:15.838320 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-50cef5b7-8f5b-4ba2-a003-c5653e1cd285 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:15.846856 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-50cef5b7-8f5b-4ba2-a003-c5653e1cd285 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:15.848630 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-50cef5b7-8f5b-4ba2-a003-c5653e1cd285 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:15.850061 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-50cef5b7-8f5b-4ba2-a003-c5653e1cd285 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1809 microversion: 2.20 time: 0.223813 Jun 17 08:55:15.850716 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 275/558] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:55:15 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1809 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:55:15.868808 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-bfc4dcc2-2c5d-4a1c-af60-006d426f4702 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:15.871025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=100 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:15.877112 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-bfc4dcc2-2c5d-4a1c-af60-006d426f4702 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.212569 Jun 17 08:55:15.877684 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 284/559] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:15 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:55:16.293185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3bedcb25-cece-48f3-a936-070b76745d4e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:16.293800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-3bedcb25-cece-48f3-a936-070b76745d4e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:16.300204 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3bedcb25-cece-48f3-a936-070b76745d4e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:16.300653 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3bedcb25-cece-48f3-a936-070b76745d4e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:16.301423 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3bedcb25-cece-48f3-a936-070b76745d4e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:16.301856 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3bedcb25-cece-48f3-a936-070b76745d4e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:16.365044 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3bedcb25-cece-48f3-a936-070b76745d4e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:16.373805 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-3bedcb25-cece-48f3-a936-070b76745d4e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1270 microversion: 2.1 time: 0.084463 Jun 17 08:55:16.374380 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 276/560] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:16 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1270 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:16.868879 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-b80fc29a-c0b9-4df1-a160-543d69bb36d6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:16.869626 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-b80fc29a-c0b9-4df1-a160-543d69bb36d6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:16.876448 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b80fc29a-c0b9-4df1-a160-543d69bb36d6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:16.876901 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b80fc29a-c0b9-4df1-a160-543d69bb36d6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:16.877674 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b80fc29a-c0b9-4df1-a160-543d69bb36d6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:16.878109 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b80fc29a-c0b9-4df1-a160-543d69bb36d6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:16.894385 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-fbb363ec-dead-4807-bfe8-9d5da8799ace tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:16.895650 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-fbb363ec-dead-4807-bfe8-9d5da8799ace tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:16.904632 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fbb363ec-dead-4807-bfe8-9d5da8799ace tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:16.905335 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fbb363ec-dead-4807-bfe8-9d5da8799ace tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:16.906448 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fbb363ec-dead-4807-bfe8-9d5da8799ace tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:16.907035 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fbb363ec-dead-4807-bfe8-9d5da8799ace tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:17.128068 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-b80fc29a-c0b9-4df1-a160-543d69bb36d6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:17.147318 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-b80fc29a-c0b9-4df1-a160-543d69bb36d6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:17.148965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-b80fc29a-c0b9-4df1-a160-543d69bb36d6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:17.150166 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-b80fc29a-c0b9-4df1-a160-543d69bb36d6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1809 microversion: 2.20 time: 0.285670 Jun 17 08:55:17.150755 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 285/561] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:55:16 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1809 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:55:17.165862 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-fbb363ec-dead-4807-bfe8-9d5da8799ace tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:17.174927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-fbb363ec-dead-4807-bfe8-9d5da8799ace tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.284683 Jun 17 08:55:17.175900 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 277/562] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:16 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:55:17.390922 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-2988857f-ce9f-4a05-93d9-6d8b1b912f87 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:17.391545 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-2988857f-ce9f-4a05-93d9-6d8b1b912f87 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:17.398562 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2988857f-ce9f-4a05-93d9-6d8b1b912f87 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:17.399008 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2988857f-ce9f-4a05-93d9-6d8b1b912f87 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:17.399879 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2988857f-ce9f-4a05-93d9-6d8b1b912f87 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:17.400313 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2988857f-ce9f-4a05-93d9-6d8b1b912f87 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:17.463751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-2988857f-ce9f-4a05-93d9-6d8b1b912f87 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:17.472621 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-2988857f-ce9f-4a05-93d9-6d8b1b912f87 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1278 microversion: 2.1 time: 0.085418 Jun 17 08:55:17.473641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 286/563] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:17 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1278 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:17.627370 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-857790f5-67ba-44d7-a1f6-3d69308952a2 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:17.628137 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-857790f5-67ba-44d7-a1f6-3d69308952a2 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:17.635265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-857790f5-67ba-44d7-a1f6-3d69308952a2 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:17.635834 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-857790f5-67ba-44d7-a1f6-3d69308952a2 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:17.636690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-857790f5-67ba-44d7-a1f6-3d69308952a2 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:17.637201 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-857790f5-67ba-44d7-a1f6-3d69308952a2 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:17.812746 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-857790f5-67ba-44d7-a1f6-3d69308952a2 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:17.830940 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-857790f5-67ba-44d7-a1f6-3d69308952a2 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1594 microversion: 2.1 time: 0.206949 Jun 17 08:55:17.832028 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 278/564] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:17 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1594 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:18.169632 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-5c9c1ad6-a6bb-45e4-a542-2c64854acbd9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:18.170354 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-5c9c1ad6-a6bb-45e4-a542-2c64854acbd9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:18.176965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5c9c1ad6-a6bb-45e4-a542-2c64854acbd9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:18.177403 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5c9c1ad6-a6bb-45e4-a542-2c64854acbd9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:18.179163 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5c9c1ad6-a6bb-45e4-a542-2c64854acbd9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:18.179967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5c9c1ad6-a6bb-45e4-a542-2c64854acbd9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:18.196918 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-609680eb-cb3f-4d9d-a5e2-6d401f1e2481 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:18.197935 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-609680eb-cb3f-4d9d-a5e2-6d401f1e2481 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:18.207991 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-609680eb-cb3f-4d9d-a5e2-6d401f1e2481 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:18.208512 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-609680eb-cb3f-4d9d-a5e2-6d401f1e2481 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:18.209526 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-609680eb-cb3f-4d9d-a5e2-6d401f1e2481 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:18.210014 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-609680eb-cb3f-4d9d-a5e2-6d401f1e2481 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:18.491697 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-5c9c1ad6-a6bb-45e4-a542-2c64854acbd9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:18.502281 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-5c9c1ad6-a6bb-45e4-a542-2c64854acbd9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:18.505562 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-5c9c1ad6-a6bb-45e4-a542-2c64854acbd9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:18.505562 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-5c9c1ad6-a6bb-45e4-a542-2c64854acbd9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1809 microversion: 2.20 time: 0.339432 Jun 17 08:55:18.505985 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 287/565] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:55:18 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1809 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:55:18.511518 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-4884c84a-bc32-4d15-b39f-796920b2ebe3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:18.512479 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-4884c84a-bc32-4d15-b39f-796920b2ebe3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:18.514457 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_api:SELECT=88 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:18.519334 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4884c84a-bc32-4d15-b39f-796920b2ebe3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:18.520123 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4884c84a-bc32-4d15-b39f-796920b2ebe3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:18.521345 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4884c84a-bc32-4d15-b39f-796920b2ebe3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:18.522797 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4884c84a-bc32-4d15-b39f-796920b2ebe3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:18.549622 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-609680eb-cb3f-4d9d-a5e2-6d401f1e2481 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:18.557987 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-609680eb-cb3f-4d9d-a5e2-6d401f1e2481 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.367905 Jun 17 08:55:18.568703 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 279/566] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:18 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:18.735727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-4884c84a-bc32-4d15-b39f-796920b2ebe3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:18.757369 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-4884c84a-bc32-4d15-b39f-796920b2ebe3 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1318 microversion: 2.1 time: 0.247733 Jun 17 08:55:18.757974 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 288/567] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:18 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:18.972346 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-d2ca6885-f206-4b4e-9f03-198207fe7923 req-4239e4e9-f53c-4792-b1fa-dce96fe005a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397d996b-b163-4a47-856e-f2aca2ae6976", "name": "network-vif-plugged", "status": "completed", "tag": "051f4b45-cbb1-44c1-92a3-54becef75c28"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:55:18.983222 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-d2ca6885-f206-4b4e-9f03-198207fe7923 req-4239e4e9-f53c-4792-b1fa-dce96fe005a3 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:18.983956 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-d2ca6885-f206-4b4e-9f03-198207fe7923 req-4239e4e9-f53c-4792-b1fa-dce96fe005a3 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:18.996318 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-d2ca6885-f206-4b4e-9f03-198207fe7923 req-4239e4e9-f53c-4792-b1fa-dce96fe005a3 service nova] Creating event network-vif-plugged:051f4b45-cbb1-44c1-92a3-54becef75c28 for instance 397d996b-b163-4a47-856e-f2aca2ae6976 on hv-cinder-79760 Jun 17 08:55:19.001451 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-d2ca6885-f206-4b4e-9f03-198207fe7923 req-4239e4e9-f53c-4792-b1fa-dce96fe005a3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032854 Jun 17 08:55:19.002054 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 280/568] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:55:19.371935 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-bf3e32e3-b15f-423f-90b0-0e8827eb97d2 req-014e6674-a525-4168-acb5-d02cc2132edd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ab550e7-cda1-4950-a919-b651030c1083", "tag": "e561f750-e056-412b-80ea-540dd4045e2d"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:55:19.380797 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-bf3e32e3-b15f-423f-90b0-0e8827eb97d2 req-014e6674-a525-4168-acb5-d02cc2132edd service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:19.382368 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-bf3e32e3-b15f-423f-90b0-0e8827eb97d2 req-014e6674-a525-4168-acb5-d02cc2132edd service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:19.394676 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-bf3e32e3-b15f-423f-90b0-0e8827eb97d2 req-014e6674-a525-4168-acb5-d02cc2132edd service nova] Creating event network-changed:e561f750-e056-412b-80ea-540dd4045e2d for instance 3ab550e7-cda1-4950-a919-b651030c1083 on hv-cinder-79760 Jun 17 08:55:19.401837 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-bf3e32e3-b15f-423f-90b0-0e8827eb97d2 req-014e6674-a525-4168-acb5-d02cc2132edd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031926 Jun 17 08:55:19.401837 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 289/569] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:55:19.525150 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0720b5be-41c0-4b8a-b988-63672016ae0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:19.526003 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0720b5be-41c0-4b8a-b988-63672016ae0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:19.534505 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0720b5be-41c0-4b8a-b988-63672016ae0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:19.535200 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0720b5be-41c0-4b8a-b988-63672016ae0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:19.536039 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0720b5be-41c0-4b8a-b988-63672016ae0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:19.536479 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0720b5be-41c0-4b8a-b988-63672016ae0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:19.576307 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-c5ffb1da-2351-4a51-b195-92be8c9cc9d7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:19.577135 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-c5ffb1da-2351-4a51-b195-92be8c9cc9d7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:19.583653 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c5ffb1da-2351-4a51-b195-92be8c9cc9d7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:19.584185 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c5ffb1da-2351-4a51-b195-92be8c9cc9d7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:19.585252 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c5ffb1da-2351-4a51-b195-92be8c9cc9d7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:19.585768 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c5ffb1da-2351-4a51-b195-92be8c9cc9d7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:19.843952 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0720b5be-41c0-4b8a-b988-63672016ae0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:19.853143 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0720b5be-41c0-4b8a-b988-63672016ae0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:19.854757 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0720b5be-41c0-4b8a-b988-63672016ae0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:19.855959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0720b5be-41c0-4b8a-b988-63672016ae0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1809 microversion: 2.20 time: 0.335845 Jun 17 08:55:19.856517 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 281/570] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:55:19 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1809 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:55:19.860592 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c5ffb1da-2351-4a51-b195-92be8c9cc9d7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:19.861059 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d485e10d-b46c-4cca-a067-778de6a926f5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:19.861667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-d485e10d-b46c-4cca-a067-778de6a926f5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:19.869017 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d485e10d-b46c-4cca-a067-778de6a926f5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:19.869469 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d485e10d-b46c-4cca-a067-778de6a926f5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:19.870263 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d485e10d-b46c-4cca-a067-778de6a926f5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:19.870872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d485e10d-b46c-4cca-a067-778de6a926f5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:19.872190 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-c5ffb1da-2351-4a51-b195-92be8c9cc9d7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1501 microversion: 2.1 time: 0.300239 Jun 17 08:55:19.876813 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 290/571] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:19 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1501 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:55:19.892695 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-f3ee5463-7776-41ba-a5b1-30854d99a700 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "629cc3f7-aa05-4c0d-9b45-8e4de7456c61"}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:55:19.893946 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-f3ee5463-7776-41ba-a5b1-30854d99a700 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:19.900280 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f3ee5463-7776-41ba-a5b1-30854d99a700 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:19.900807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f3ee5463-7776-41ba-a5b1-30854d99a700 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:19.910283 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f3ee5463-7776-41ba-a5b1-30854d99a700 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:19.910283 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f3ee5463-7776-41ba-a5b1-30854d99a700 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:19.935480 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-f3ee5463-7776-41ba-a5b1-30854d99a700 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] HTTP exception thrown: Cannot 'attach_volume' instance 597a895e-45db-42bf-9c7f-40a13eedc48b while it is in vm_state rescued Jun 17 08:55:19.937569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-f3ee5463-7776-41ba-a5b1-30854d99a700 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Request method failure captured: Jun 17 08:55:19.937569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: POST /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b/os-volume_attachments HTTP/1.1 Jun 17 08:55:19.937569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:55:19.937569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:55:19.937569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:55:19.937569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 74 Jun 17 08:55:19.937569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:55:19.937569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:55:19.937569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:55:19.937569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:55:19.937569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirED5Euje8Qg466HZfzI6zCL6KuGF5BH7fLi2Pmi8ij3gYtPI6C-73btuLA8X2nSXoPf1noq4TUDtlOwCduBS9xL7_px9uXygULPkVYrbJQFD3qLcxvxV0BbEkrPf4s4e0iVeOxxYopv4Knn2YUw0jM9QPTqum78gRvcAfDjXtIdH9hY Jun 17 08:55:19.937569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:55:19.937569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:55:19.937569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:55:19.937569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:55:19.937569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:55:19.937569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:55:19.937569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: 6cd5b6aa6edd4bafa8aec3e9d28ae980 Jun 17 08:55:19.937569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1528519624 Jun 17 08:55:19.937569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:55:19.937569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:55:19.939001 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6cd5b6aa6edd4bafa8aec3e9d28ae980"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6cd5b6aa6edd4bafa8aec3e9d28ae980"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6cd5b6aa6edd4bafa8aec3e9d28ae980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6cd5b6aa6edd4bafa8aec3e9d28ae980"}]}] Jun 17 08:55:19.939001 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1528519624 Jun 17 08:55:19.939001 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: 6cd5b6aa6edd4bafa8aec3e9d28ae980 Jun 17 08:55:19.939001 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1528519624 Jun 17 08:55:19.939001 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-ServerRescueNegativeTestJSON-1528519624-project Jun 17 08:55:19.939001 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:55:19.939001 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:55:19.939001 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: 5e4214dbd10d491eb6afa50321edca88 Jun 17 08:55:19.939001 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1528519624-project Jun 17 08:55:19.939001 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Jun 17 08:55:19.939001 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {"volumeAttachment": {"volumeId": "629cc3f7-aa05-4c0d-9b45-8e4de7456c61"}} Jun 17 08:55:19.939001 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 08:55:19.940040 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Cannot 'attach_volume' instance 597a895e-45db-42bf-9c7f-40a13eedc48b while it is in vm_state rescued Jun 17 08:55:19.940040 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'server_id': '597a895e-45db-42bf-9c7f-40a13eedc48b', 'body': {'volumeAttachment': {'volumeId': '629cc3f7-aa05-4c0d-9b45-8e4de7456c61'}}} Jun 17 08:55:19.940040 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:55:19.940040 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:55:19.940040 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 17 08:55:19.940040 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 17 08:55:19.940040 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 08:55:19.940040 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 08:55:19.940040 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 17 08:55:19.940040 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 17 08:55:19.940040 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 597a895e-45db-42bf-9c7f-40a13eedc48b in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 17 08:55:19.940040 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:55:19.940040 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:55:19.940040 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:55:19.940040 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:55:19.940040 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:55:19.940040 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:55:19.940040 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:55:19.940040 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:55:19.941243 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:55:19.941243 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:55:19.941243 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 08:55:19.941243 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 08:55:19.941243 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 08:55:19.941243 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 08:55:19.941243 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 08:55:19.941243 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 08:55:19.941243 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 17 08:55:19.941243 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 17 08:55:19.941243 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 17 08:55:19.941243 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 17 08:55:19.941243 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 597a895e-45db-42bf-9c7f-40a13eedc48b while it is in vm_state rescued Jun 17 08:55:19.941243 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:55:19.941243 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:55:19.941243 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:55:19.941243 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:55:19.941243 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:55:19.941243 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:55:19.942377 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:55:19.942377 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:55:19.942377 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 597a895e-45db-42bf-9c7f-40a13eedc48b while it is in vm_state rescued Jun 17 08:55:19.942377 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:55:19.944633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-f3ee5463-7776-41ba-a5b1-30854d99a700 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Returning 409 to user: Cannot 'attach_volume' instance 597a895e-45db-42bf-9c7f-40a13eedc48b while it is in vm_state rescued {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:55:19.945640 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-f3ee5463-7776-41ba-a5b1-30854d99a700 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "POST /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.057371 Jun 17 08:55:19.946230 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 291/572] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jun 17 08:55:19 2022] POST /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 17 08:55:19.955728 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-20d59b07-bf97-4059-be9d-723ff4264aad tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:55:19.956387 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-20d59b07-bf97-4059-be9d-723ff4264aad tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:19.965589 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-20d59b07-bf97-4059-be9d-723ff4264aad tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:19.972483 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-20d59b07-bf97-4059-be9d-723ff4264aad tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:19.972483 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-20d59b07-bf97-4059-be9d-723ff4264aad tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:19.972483 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-20d59b07-bf97-4059-be9d-723ff4264aad tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:20.161789 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d485e10d-b46c-4cca-a067-778de6a926f5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:20.171870 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-d485e10d-b46c-4cca-a067-778de6a926f5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1318 microversion: 2.1 time: 0.314122 Jun 17 08:55:20.173245 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 282/573] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:19 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:20.220735 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-20d59b07-bf97-4059-be9d-723ff4264aad tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "POST /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b/action" status: 202 len: 0 microversion: 2.1 time: 0.269115 Jun 17 08:55:20.224960 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 292/574] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jun 17 08:55:19 2022] POST /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 08:55:20.233678 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a90aa95f-cbbf-412a-b89f-38d9032c09fb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:20.234281 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-a90aa95f-cbbf-412a-b89f-38d9032c09fb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:20.248097 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a90aa95f-cbbf-412a-b89f-38d9032c09fb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:20.248571 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a90aa95f-cbbf-412a-b89f-38d9032c09fb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:20.249610 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a90aa95f-cbbf-412a-b89f-38d9032c09fb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:20.250044 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a90aa95f-cbbf-412a-b89f-38d9032c09fb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:20.530697 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a90aa95f-cbbf-412a-b89f-38d9032c09fb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:20.539519 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-a90aa95f-cbbf-412a-b89f-38d9032c09fb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1509 microversion: 2.1 time: 0.310049 Jun 17 08:55:20.540353 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 283/575] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:20 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1509 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:55:20.875833 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-20f60feb-8a48-442b-91e1-7bd677c7a565 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:20.877287 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-20f60feb-8a48-442b-91e1-7bd677c7a565 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:20.884463 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-20f60feb-8a48-442b-91e1-7bd677c7a565 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:20.885247 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-20f60feb-8a48-442b-91e1-7bd677c7a565 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:20.886248 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-20f60feb-8a48-442b-91e1-7bd677c7a565 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:20.886744 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-20f60feb-8a48-442b-91e1-7bd677c7a565 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:21.045945 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-8af8403d-d352-4dff-b3c1-354c83dbdf7e req-e2615821-0f57-4ad7-8594-cbdcfa025153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e254b695-5369-48d6-9966-64f25873dc0d", "tag": "5a6e2dcc-1d88-4ebd-8cce-063737a7db08"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:55:21.066990 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-8af8403d-d352-4dff-b3c1-354c83dbdf7e req-e2615821-0f57-4ad7-8594-cbdcfa025153 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:21.067474 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-8af8403d-d352-4dff-b3c1-354c83dbdf7e req-e2615821-0f57-4ad7-8594-cbdcfa025153 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:21.080809 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-8af8403d-d352-4dff-b3c1-354c83dbdf7e req-e2615821-0f57-4ad7-8594-cbdcfa025153 service nova] Creating event network-changed:5a6e2dcc-1d88-4ebd-8cce-063737a7db08 for instance e254b695-5369-48d6-9966-64f25873dc0d on hv-cinder-79760 Jun 17 08:55:21.086154 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-8af8403d-d352-4dff-b3c1-354c83dbdf7e req-e2615821-0f57-4ad7-8594-cbdcfa025153 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046434 Jun 17 08:55:21.086771 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 284/576] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:55:21.122032 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-20f60feb-8a48-442b-91e1-7bd677c7a565 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:21.132795 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-20f60feb-8a48-442b-91e1-7bd677c7a565 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:21.134504 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-20f60feb-8a48-442b-91e1-7bd677c7a565 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:21.135739 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-20f60feb-8a48-442b-91e1-7bd677c7a565 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1809 microversion: 2.20 time: 0.264657 Jun 17 08:55:21.141771 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 293/577] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:55:20 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1809 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:55:21.190354 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-59876154-921f-455d-a7a0-4b3685a40704 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:21.191310 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-59876154-921f-455d-a7a0-4b3685a40704 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:21.197693 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-59876154-921f-455d-a7a0-4b3685a40704 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:21.198139 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-59876154-921f-455d-a7a0-4b3685a40704 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:21.198960 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-59876154-921f-455d-a7a0-4b3685a40704 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:21.199596 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-59876154-921f-455d-a7a0-4b3685a40704 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:21.345935 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-59876154-921f-455d-a7a0-4b3685a40704 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:21.354031 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-59876154-921f-455d-a7a0-4b3685a40704 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1318 microversion: 2.1 time: 0.167959 Jun 17 08:55:21.354609 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 285/578] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:21 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:21.556911 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-db512bbf-2448-4574-a938-fb9060376e48 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:21.557913 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-db512bbf-2448-4574-a938-fb9060376e48 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:21.570303 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-db512bbf-2448-4574-a938-fb9060376e48 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:21.570873 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-db512bbf-2448-4574-a938-fb9060376e48 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:21.571782 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-db512bbf-2448-4574-a938-fb9060376e48 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:21.572321 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-db512bbf-2448-4574-a938-fb9060376e48 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:22.054827 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-db512bbf-2448-4574-a938-fb9060376e48 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:22.064054 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-db512bbf-2448-4574-a938-fb9060376e48 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1509 microversion: 2.1 time: 0.511207 Jun 17 08:55:22.064637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 294/579] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:21 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1509 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:22.156124 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-205546e8-c9ad-4073-b8f0-1c12d1b4e2df tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:22.156766 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-205546e8-c9ad-4073-b8f0-1c12d1b4e2df tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:22.164531 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-205546e8-c9ad-4073-b8f0-1c12d1b4e2df tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:22.164986 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-205546e8-c9ad-4073-b8f0-1c12d1b4e2df tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:22.165775 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-205546e8-c9ad-4073-b8f0-1c12d1b4e2df tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:22.166220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-205546e8-c9ad-4073-b8f0-1c12d1b4e2df tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:22.305251 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-205546e8-c9ad-4073-b8f0-1c12d1b4e2df tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:22.313953 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-205546e8-c9ad-4073-b8f0-1c12d1b4e2df tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:22.315463 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-205546e8-c9ad-4073-b8f0-1c12d1b4e2df tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:22.319524 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-205546e8-c9ad-4073-b8f0-1c12d1b4e2df tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1809 microversion: 2.20 time: 0.165056 Jun 17 08:55:22.319524 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 286/580] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:55:22 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:55:22.371248 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-bbb47672-d789-48b1-b518-dca1ac02611e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:22.371905 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-bbb47672-d789-48b1-b518-dca1ac02611e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:22.378019 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bbb47672-d789-48b1-b518-dca1ac02611e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:22.378469 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bbb47672-d789-48b1-b518-dca1ac02611e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:22.379236 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bbb47672-d789-48b1-b518-dca1ac02611e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:22.379701 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bbb47672-d789-48b1-b518-dca1ac02611e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:22.515168 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-bbb47672-d789-48b1-b518-dca1ac02611e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:22.522619 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-bbb47672-d789-48b1-b518-dca1ac02611e tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1318 microversion: 2.1 time: 0.155154 Jun 17 08:55:22.523191 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 295/581] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:22 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:23.081622 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-65461bbd-142b-4c70-a572-ba425187df55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:23.082337 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-65461bbd-142b-4c70-a572-ba425187df55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:23.089076 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-65461bbd-142b-4c70-a572-ba425187df55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:23.090353 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-65461bbd-142b-4c70-a572-ba425187df55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:23.090353 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-65461bbd-142b-4c70-a572-ba425187df55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:23.090697 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-65461bbd-142b-4c70-a572-ba425187df55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:23.229002 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-65461bbd-142b-4c70-a572-ba425187df55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:23.236434 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-65461bbd-142b-4c70-a572-ba425187df55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1509 microversion: 2.1 time: 0.158762 Jun 17 08:55:23.236994 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 287/582] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:23 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:55:23.338920 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-f427cbe4-7577-48c7-a756-f1c65657e074 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:23.347318 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-f427cbe4-7577-48c7-a756-f1c65657e074 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:23.353261 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f427cbe4-7577-48c7-a756-f1c65657e074 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:23.354509 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f427cbe4-7577-48c7-a756-f1c65657e074 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:23.356090 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f427cbe4-7577-48c7-a756-f1c65657e074 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:23.356692 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f427cbe4-7577-48c7-a756-f1c65657e074 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:23.502837 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-f427cbe4-7577-48c7-a756-f1c65657e074 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:23.512861 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-f427cbe4-7577-48c7-a756-f1c65657e074 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:23.514378 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-f427cbe4-7577-48c7-a756-f1c65657e074 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:23.515598 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-f427cbe4-7577-48c7-a756-f1c65657e074 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1809 microversion: 2.20 time: 0.183738 Jun 17 08:55:23.516155 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 296/583] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:55:23 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:55:23.539653 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d040aa96-278e-4263-8131-a4d9a23dee2a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:23.540274 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-d040aa96-278e-4263-8131-a4d9a23dee2a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:23.546403 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d040aa96-278e-4263-8131-a4d9a23dee2a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:23.546848 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d040aa96-278e-4263-8131-a4d9a23dee2a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:23.547646 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d040aa96-278e-4263-8131-a4d9a23dee2a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:23.548082 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d040aa96-278e-4263-8131-a4d9a23dee2a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:23.620252 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-cff78ed9-d1bc-4efe-993c-23b830e7bf18 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2105065718"}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:55:23.621465 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-cff78ed9-d1bc-4efe-993c-23b830e7bf18 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:23.630098 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-cff78ed9-d1bc-4efe-993c-23b830e7bf18 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:23.630781 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-cff78ed9-d1bc-4efe-993c-23b830e7bf18 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:23.632713 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-cff78ed9-d1bc-4efe-993c-23b830e7bf18 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:23.633377 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-cff78ed9-d1bc-4efe-993c-23b830e7bf18 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:23.774882 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d040aa96-278e-4263-8131-a4d9a23dee2a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:23.780524 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-d040aa96-278e-4263-8131-a4d9a23dee2a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1318 microversion: 2.1 time: 0.244930 Jun 17 08:55:23.790525 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 288/584] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:23 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:23.880176 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.network.security_group_api [None req-cff78ed9-d1bc-4efe-993c-23b830e7bf18 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Adding security group 2bec96a3-5e42-48e6-a407-554f225e05bd to port 5a6e2dcc-1d88-4ebd-8cce-063737a7db08 Jun 17 08:55:24.253568 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a8b8084a-db39-47a8-8ea3-70cf6a151aff tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:24.254321 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-a8b8084a-db39-47a8-8ea3-70cf6a151aff tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:24.261188 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a8b8084a-db39-47a8-8ea3-70cf6a151aff tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:24.261633 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a8b8084a-db39-47a8-8ea3-70cf6a151aff tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:24.262404 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a8b8084a-db39-47a8-8ea3-70cf6a151aff tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:24.262839 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a8b8084a-db39-47a8-8ea3-70cf6a151aff tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:24.344266 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-cff78ed9-d1bc-4efe-993c-23b830e7bf18 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "POST /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d/action" status: 202 len: 0 microversion: 2.1 time: 0.715967 Jun 17 08:55:24.344266 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 297/585] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jun 17 08:55:23 2022] POST /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d/action => generated 0 bytes in 718 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 08:55:24.354987 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-cb1ad988-d3de-424c-9e5b-4e9b9e7991f6 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:24.355728 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-cb1ad988-d3de-424c-9e5b-4e9b9e7991f6 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:24.364564 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-cb1ad988-d3de-424c-9e5b-4e9b9e7991f6 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:24.365007 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-cb1ad988-d3de-424c-9e5b-4e9b9e7991f6 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:24.366048 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-cb1ad988-d3de-424c-9e5b-4e9b9e7991f6 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:24.382350 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-cb1ad988-d3de-424c-9e5b-4e9b9e7991f6 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:24.575610 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a8b8084a-db39-47a8-8ea3-70cf6a151aff tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:24.583832 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-a8b8084a-db39-47a8-8ea3-70cf6a151aff tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1509 microversion: 2.1 time: 0.334038 Jun 17 08:55:24.595075 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 289/586] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:24 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1509 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:24.609931 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-60580b36-c1a5-4c06-b241-5242f41733a0 req-03e90071-ecd4-4d12-95ea-4ac67bd17bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e254b695-5369-48d6-9966-64f25873dc0d", "tag": "5a6e2dcc-1d88-4ebd-8cce-063737a7db08"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:55:24.633054 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-60580b36-c1a5-4c06-b241-5242f41733a0 req-03e90071-ecd4-4d12-95ea-4ac67bd17bb0 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:24.636857 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-60580b36-c1a5-4c06-b241-5242f41733a0 req-03e90071-ecd4-4d12-95ea-4ac67bd17bb0 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:24.661705 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-60580b36-c1a5-4c06-b241-5242f41733a0 req-03e90071-ecd4-4d12-95ea-4ac67bd17bb0 service nova] Creating event network-changed:5a6e2dcc-1d88-4ebd-8cce-063737a7db08 for instance e254b695-5369-48d6-9966-64f25873dc0d on hv-cinder-79760 Jun 17 08:55:24.668953 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-60580b36-c1a5-4c06-b241-5242f41733a0 req-03e90071-ecd4-4d12-95ea-4ac67bd17bb0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071907 Jun 17 08:55:24.670219 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 290/587] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:55:24.676002 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-69c1b4ee-970b-4999-86ca-142905854f71 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:24.677982 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-69c1b4ee-970b-4999-86ca-142905854f71 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:24.685285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-69c1b4ee-970b-4999-86ca-142905854f71 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:24.685797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-69c1b4ee-970b-4999-86ca-142905854f71 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:24.686496 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-69c1b4ee-970b-4999-86ca-142905854f71 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:24.686957 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-69c1b4ee-970b-4999-86ca-142905854f71 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:24.704863 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-cb1ad988-d3de-424c-9e5b-4e9b9e7991f6 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:24.717065 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-cb1ad988-d3de-424c-9e5b-4e9b9e7991f6 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1641 microversion: 2.1 time: 0.376505 Jun 17 08:55:24.717788 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 298/588] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:24 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1641 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:24.807768 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-f8f1eec8-4da0-4e66-9272-1e0615adb490 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:24.810980 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-f8f1eec8-4da0-4e66-9272-1e0615adb490 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:24.854713 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f8f1eec8-4da0-4e66-9272-1e0615adb490 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:24.856741 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f8f1eec8-4da0-4e66-9272-1e0615adb490 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:24.857653 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f8f1eec8-4da0-4e66-9272-1e0615adb490 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:24.860275 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f8f1eec8-4da0-4e66-9272-1e0615adb490 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:24.911160 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-69c1b4ee-970b-4999-86ca-142905854f71 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:24.927664 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-69c1b4ee-970b-4999-86ca-142905854f71 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:24.928749 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-69c1b4ee-970b-4999-86ca-142905854f71 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:24.930308 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-69c1b4ee-970b-4999-86ca-142905854f71 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1809 microversion: 2.20 time: 0.258603 Jun 17 08:55:24.931420 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 291/589] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:55:24 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1809 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:55:25.030349 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-f8f1eec8-4da0-4e66-9272-1e0615adb490 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:25.045060 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-f8f1eec8-4da0-4e66-9272-1e0615adb490 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1318 microversion: 2.1 time: 0.250486 Jun 17 08:55:25.046171 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 299/590] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:24 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:25.601352 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-ce68225e-ce0b-417d-b1f6-124cbf698c80 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:25.601971 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-ce68225e-ce0b-417d-b1f6-124cbf698c80 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:25.608772 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ce68225e-ce0b-417d-b1f6-124cbf698c80 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:25.609217 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ce68225e-ce0b-417d-b1f6-124cbf698c80 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:25.610002 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ce68225e-ce0b-417d-b1f6-124cbf698c80 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:25.610442 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ce68225e-ce0b-417d-b1f6-124cbf698c80 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:25.756278 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-ce68225e-ce0b-417d-b1f6-124cbf698c80 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:25.763930 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-ce68225e-ce0b-417d-b1f6-124cbf698c80 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1509 microversion: 2.1 time: 0.166627 Jun 17 08:55:25.764503 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 292/591] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:25 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:25.950029 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-30d7c532-e992-46c4-83f9-8e669def1678 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:25.950728 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-30d7c532-e992-46c4-83f9-8e669def1678 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:25.957454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-30d7c532-e992-46c4-83f9-8e669def1678 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:25.957911 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-30d7c532-e992-46c4-83f9-8e669def1678 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:25.958709 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-30d7c532-e992-46c4-83f9-8e669def1678 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:25.959755 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-30d7c532-e992-46c4-83f9-8e669def1678 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:26.073630 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-33d21402-4344-4462-ab17-92ff5136f1f1 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:26.074434 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-33d21402-4344-4462-ab17-92ff5136f1f1 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:26.082384 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-33d21402-4344-4462-ab17-92ff5136f1f1 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:26.083198 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-33d21402-4344-4462-ab17-92ff5136f1f1 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:26.085060 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-33d21402-4344-4462-ab17-92ff5136f1f1 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:26.085820 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-33d21402-4344-4462-ab17-92ff5136f1f1 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:26.102293 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-30d7c532-e992-46c4-83f9-8e669def1678 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:26.111454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-30d7c532-e992-46c4-83f9-8e669def1678 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:26.113261 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-30d7c532-e992-46c4-83f9-8e669def1678 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:26.114650 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-30d7c532-e992-46c4-83f9-8e669def1678 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1809 microversion: 2.20 time: 0.168832 Jun 17 08:55:26.115450 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 300/592] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:55:25 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:55:26.220936 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-33d21402-4344-4462-ab17-92ff5136f1f1 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:26.228830 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-33d21402-4344-4462-ab17-92ff5136f1f1 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1318 microversion: 2.1 time: 0.159537 Jun 17 08:55:26.229396 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 293/593] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:26 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:26.782006 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-1e7cfd2c-c7e7-44f4-90f3-c7de6a92a6a7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:26.782608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-1e7cfd2c-c7e7-44f4-90f3-c7de6a92a6a7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:26.789544 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1e7cfd2c-c7e7-44f4-90f3-c7de6a92a6a7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:26.789989 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1e7cfd2c-c7e7-44f4-90f3-c7de6a92a6a7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:26.791595 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1e7cfd2c-c7e7-44f4-90f3-c7de6a92a6a7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:26.792095 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1e7cfd2c-c7e7-44f4-90f3-c7de6a92a6a7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:26.929445 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-1e7cfd2c-c7e7-44f4-90f3-c7de6a92a6a7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:26.931940 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:26.938178 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-1e7cfd2c-c7e7-44f4-90f3-c7de6a92a6a7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1509 microversion: 2.1 time: 0.159997 Jun 17 08:55:26.938745 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 301/594] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:26 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:27.133581 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0cc9943d-b6bd-45c6-a73d-43673214984b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:27.134215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0cc9943d-b6bd-45c6-a73d-43673214984b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:27.140738 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0cc9943d-b6bd-45c6-a73d-43673214984b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:27.141180 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0cc9943d-b6bd-45c6-a73d-43673214984b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:27.142022 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0cc9943d-b6bd-45c6-a73d-43673214984b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:27.142457 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0cc9943d-b6bd-45c6-a73d-43673214984b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:27.147262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=100 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:27.245510 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-6cdd8bd2-cad0-48e2-8a71-b6470ce1c82b tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:27.246236 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-6cdd8bd2-cad0-48e2-8a71-b6470ce1c82b tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:27.253509 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6cdd8bd2-cad0-48e2-8a71-b6470ce1c82b tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:27.253955 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6cdd8bd2-cad0-48e2-8a71-b6470ce1c82b tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:27.254834 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6cdd8bd2-cad0-48e2-8a71-b6470ce1c82b tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:27.255275 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6cdd8bd2-cad0-48e2-8a71-b6470ce1c82b tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:27.273958 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0cc9943d-b6bd-45c6-a73d-43673214984b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:27.282425 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0cc9943d-b6bd-45c6-a73d-43673214984b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:27.283943 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0cc9943d-b6bd-45c6-a73d-43673214984b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:27.285095 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0cc9943d-b6bd-45c6-a73d-43673214984b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1796 microversion: 2.20 time: 0.156050 Jun 17 08:55:27.285649 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 294/595] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:55:27 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1796 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:55:27.389331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-6cdd8bd2-cad0-48e2-8a71-b6470ce1c82b tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:27.432528 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-6cdd8bd2-cad0-48e2-8a71-b6470ce1c82b tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1318 microversion: 2.1 time: 0.157554 Jun 17 08:55:27.432528 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 302/596] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:27 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:55:27.650957 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-4b7532fa-e1e6-49fb-aa7e-28fb483d7bef req-89e08089-f475-46b6-a3f7-4dc4813ca4ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ab550e7-cda1-4950-a919-b651030c1083", "name": "network-vif-plugged", "status": "completed", "tag": "e561f750-e056-412b-80ea-540dd4045e2d"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:55:27.659451 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-4b7532fa-e1e6-49fb-aa7e-28fb483d7bef req-89e08089-f475-46b6-a3f7-4dc4813ca4ad service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:27.659898 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-4b7532fa-e1e6-49fb-aa7e-28fb483d7bef req-89e08089-f475-46b6-a3f7-4dc4813ca4ad service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:27.672113 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-4b7532fa-e1e6-49fb-aa7e-28fb483d7bef req-89e08089-f475-46b6-a3f7-4dc4813ca4ad service nova] Creating event network-vif-plugged:e561f750-e056-412b-80ea-540dd4045e2d for instance 3ab550e7-cda1-4950-a919-b651030c1083 on hv-cinder-79760 Jun 17 08:55:27.677219 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-4b7532fa-e1e6-49fb-aa7e-28fb483d7bef req-89e08089-f475-46b6-a3f7-4dc4813ca4ad service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029982 Jun 17 08:55:27.678648 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 295/597] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:55:27.957786 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-98a71cd8-a3f4-4ed9-bc5f-8ae647fff01a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:27.958470 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-98a71cd8-a3f4-4ed9-bc5f-8ae647fff01a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:27.967256 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-98a71cd8-a3f4-4ed9-bc5f-8ae647fff01a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:27.967842 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-98a71cd8-a3f4-4ed9-bc5f-8ae647fff01a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:27.968545 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-98a71cd8-a3f4-4ed9-bc5f-8ae647fff01a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:27.969007 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-98a71cd8-a3f4-4ed9-bc5f-8ae647fff01a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:28.129317 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-98a71cd8-a3f4-4ed9-bc5f-8ae647fff01a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:28.138248 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-98a71cd8-a3f4-4ed9-bc5f-8ae647fff01a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1509 microversion: 2.1 time: 0.185002 Jun 17 08:55:28.138840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 303/598] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:27 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:28.448986 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-990f7d76-c480-447a-9e8c-da2f8e9f6adb tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:28.449878 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-990f7d76-c480-447a-9e8c-da2f8e9f6adb tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:28.456664 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-990f7d76-c480-447a-9e8c-da2f8e9f6adb tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:28.457217 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-990f7d76-c480-447a-9e8c-da2f8e9f6adb tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:28.457932 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-990f7d76-c480-447a-9e8c-da2f8e9f6adb tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:28.458374 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-990f7d76-c480-447a-9e8c-da2f8e9f6adb tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:28.596831 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-990f7d76-c480-447a-9e8c-da2f8e9f6adb tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:28.606980 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-990f7d76-c480-447a-9e8c-da2f8e9f6adb tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1318 microversion: 2.1 time: 0.162417 Jun 17 08:55:28.607605 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 296/599] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:28 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:29.155708 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e6f93980-857b-47e5-ade5-1b6bbd4385a7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:29.156256 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-e6f93980-857b-47e5-ade5-1b6bbd4385a7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:29.163566 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e6f93980-857b-47e5-ade5-1b6bbd4385a7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:29.164026 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e6f93980-857b-47e5-ade5-1b6bbd4385a7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:29.164792 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e6f93980-857b-47e5-ade5-1b6bbd4385a7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:29.165232 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e6f93980-857b-47e5-ade5-1b6bbd4385a7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:29.306792 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e6f93980-857b-47e5-ade5-1b6bbd4385a7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:29.314469 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-e6f93980-857b-47e5-ade5-1b6bbd4385a7 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1515 microversion: 2.1 time: 0.162712 Jun 17 08:55:29.315039 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 304/600] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:29 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:29.624531 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-688c6ce4-f2cc-4461-b371-661fc40470d1 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:29.625271 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-688c6ce4-f2cc-4461-b371-661fc40470d1 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:29.632756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-688c6ce4-f2cc-4461-b371-661fc40470d1 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:29.633530 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-688c6ce4-f2cc-4461-b371-661fc40470d1 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:29.633967 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-688c6ce4-f2cc-4461-b371-661fc40470d1 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:29.634412 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-688c6ce4-f2cc-4461-b371-661fc40470d1 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:29.779804 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-688c6ce4-f2cc-4461-b371-661fc40470d1 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:29.788182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-688c6ce4-f2cc-4461-b371-661fc40470d1 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1318 microversion: 2.1 time: 0.167419 Jun 17 08:55:29.788763 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 297/601] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:29 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:55:30.805831 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-118aae29-f674-4e75-9fe0-648e6b03bd15 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:30.806953 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-118aae29-f674-4e75-9fe0-648e6b03bd15 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:30.815003 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-118aae29-f674-4e75-9fe0-648e6b03bd15 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:30.815745 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-118aae29-f674-4e75-9fe0-648e6b03bd15 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:30.816527 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-118aae29-f674-4e75-9fe0-648e6b03bd15 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:30.816970 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-118aae29-f674-4e75-9fe0-648e6b03bd15 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:30.862936 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-beb204e2-b4e0-42df-af37-bb0b57c841c5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Action: 'create', calling method: .version_select at 0x7fbc401fca60>, body: {"keypair": {"name": "tempest-keypair-433164063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDpCoub1Ko1rPuTKMew4GGj0ovEwwHnFNDvxw0JW5yk2R07A2qRoY5zSRSv77wDo3cJvcCHOjutRfrVj2pb4iup62bAZu1d5g0Bkfnd3ao9cyKFgDQZWo3puzzB7jQRYw=="}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:55:30.882186 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-beb204e2-b4e0-42df-af37-bb0b57c841c5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Getting quotas for project 6cd5b6aa6edd4bafa8aec3e9d28ae980. Resources: {'key_pairs'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:55:30.886581 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-beb204e2-b4e0-42df-af37-bb0b57c841c5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Getting quotas for user 5e4214dbd10d491eb6afa50321edca88 and project 6cd5b6aa6edd4bafa8aec3e9d28ae980. Resources: {'key_pairs'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:55:30.966754 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-118aae29-f674-4e75-9fe0-648e6b03bd15 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:30.974349 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-118aae29-f674-4e75-9fe0-648e6b03bd15 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1506 microversion: 2.1 time: 0.173553 Jun 17 08:55:30.974905 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 305/602] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:30 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:55:30.990686 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-8c0b111c-940c-4117-8ac7-9c888411db13 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b581e24-9091-43d4-b12c-5c0c85f53b76", "device": "/dev/sdb"}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:55:30.991888 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-8c0b111c-940c-4117-8ac7-9c888411db13 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:30.993054 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-beb204e2-b4e0-42df-af37-bb0b57c841c5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.133847 Jun 17 08:55:30.993666 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 298/603] 10.222.0.78 () {60 vars in 1158 bytes} [Fri Jun 17 08:55:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:55:30.998282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8c0b111c-940c-4117-8ac7-9c888411db13 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:30.998952 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8c0b111c-940c-4117-8ac7-9c888411db13 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:30.999916 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8c0b111c-940c-4117-8ac7-9c888411db13 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:31.000351 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8c0b111c-940c-4117-8ac7-9c888411db13 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:31.784867 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-8c0b111c-940c-4117-8ac7-9c888411db13 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "POST /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.797840 Jun 17 08:55:31.785488 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 306/604] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jun 17 08:55:30 2022] POST /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083/os-volume_attachments => generated 194 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:55:33.285357 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-95515203-5fb0-4e5f-b1f6-27b3dddf7702 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1786970035", "imageRef": "978084c7-ed2c-4e42-ac8b-f5d19c4001fe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8fa13e99-aed9-4194-a577-7ffc636408e6"}], "security_groups": [{"name": "tempest-securitygroup--293804817"}], "key_name": "tempest-keypair-433164063", "user_data": "}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:55:33.406459 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.network.neutron [None req-95515203-5fb0-4e5f-b1f6-27b3dddf7702 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] validate_networks() for [('8fa13e99-aed9-4194-a577-7ffc636408e6', None, None, None, None, None)] {{(pid=129875) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:55:33.781747 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-95515203-5fb0-4e5f-b1f6-27b3dddf7702 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Flavor limits 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:55:33.782117 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-95515203-5fb0-4e5f-b1f6-27b3dddf7702 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Image limits 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:55:33.782583 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-95515203-5fb0-4e5f-b1f6-27b3dddf7702 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Flavor pref 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:55:33.782987 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-95515203-5fb0-4e5f-b1f6-27b3dddf7702 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Image pref 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:55:33.783422 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-95515203-5fb0-4e5f-b1f6-27b3dddf7702 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:55:33.792740 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-95515203-5fb0-4e5f-b1f6-27b3dddf7702 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:33.793260 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-95515203-5fb0-4e5f-b1f6-27b3dddf7702 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:33.793959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-95515203-5fb0-4e5f-b1f6-27b3dddf7702 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:33.794415 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-95515203-5fb0-4e5f-b1f6-27b3dddf7702 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:33.811519 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-95515203-5fb0-4e5f-b1f6-27b3dddf7702 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Getting quotas for project 6cd5b6aa6edd4bafa8aec3e9d28ae980. Resources: {'ram', 'cores', 'instances'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:55:33.815465 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-95515203-5fb0-4e5f-b1f6-27b3dddf7702 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Getting quotas for user 5e4214dbd10d491eb6afa50321edca88 and project 6cd5b6aa6edd4bafa8aec3e9d28ae980. Resources: {'ram', 'cores', 'instances'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:55:33.826977 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-95515203-5fb0-4e5f-b1f6-27b3dddf7702 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Going to run 1 instances... {{(pid=129875) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:55:33.829243 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-95515203-5fb0-4e5f-b1f6-27b3dddf7702 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='978084c7-ed2c-4e42-ac8b-f5d19c4001fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:55:33.953474 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-95515203-5fb0-4e5f-b1f6-27b3dddf7702 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.673210 Jun 17 08:55:33.954116 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 299/605] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jun 17 08:55:33 2022] POST /compute/v2.1/servers => generated 408 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:55:33.966256 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a40abe78-a60a-4909-aa6a-3c0d921a342a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:33.966973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a40abe78-a60a-4909-aa6a-3c0d921a342a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:34.029511 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a40abe78-a60a-4909-aa6a-3c0d921a342a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:34.036862 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a40abe78-a60a-4909-aa6a-3c0d921a342a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1245 microversion: 2.1 time: 0.075302 Jun 17 08:55:34.037604 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 307/606] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:33 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1245 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:35.054993 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-f752b5f5-77a8-4993-8576-3b7a8c4cff55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:35.055652 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-f752b5f5-77a8-4993-8576-3b7a8c4cff55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:35.063167 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f752b5f5-77a8-4993-8576-3b7a8c4cff55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:35.063645 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f752b5f5-77a8-4993-8576-3b7a8c4cff55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:35.064422 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f752b5f5-77a8-4993-8576-3b7a8c4cff55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:35.064858 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f752b5f5-77a8-4993-8576-3b7a8c4cff55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:35.127340 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f752b5f5-77a8-4993-8576-3b7a8c4cff55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:35.135302 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-f752b5f5-77a8-4993-8576-3b7a8c4cff55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1241 microversion: 2.1 time: 0.084938 Jun 17 08:55:35.135907 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 300/607] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:35 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:36.153431 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-60032a78-f3ff-44e5-a7c7-2591e1ae04fe tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:36.154050 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-60032a78-f3ff-44e5-a7c7-2591e1ae04fe tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:36.161278 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-60032a78-f3ff-44e5-a7c7-2591e1ae04fe tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:36.162225 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-60032a78-f3ff-44e5-a7c7-2591e1ae04fe tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:36.163402 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-60032a78-f3ff-44e5-a7c7-2591e1ae04fe tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:36.163852 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-60032a78-f3ff-44e5-a7c7-2591e1ae04fe tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:36.228395 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-60032a78-f3ff-44e5-a7c7-2591e1ae04fe tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:36.236210 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-60032a78-f3ff-44e5-a7c7-2591e1ae04fe tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1315 microversion: 2.1 time: 0.086662 Jun 17 08:55:36.236785 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 308/608] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:36 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1315 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:37.255228 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d3cd6f06-6be2-4b4c-b312-84778327a589 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:37.256994 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-d3cd6f06-6be2-4b4c-b312-84778327a589 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:37.265062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d3cd6f06-6be2-4b4c-b312-84778327a589 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:37.265654 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d3cd6f06-6be2-4b4c-b312-84778327a589 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:37.266717 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d3cd6f06-6be2-4b4c-b312-84778327a589 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:37.267269 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d3cd6f06-6be2-4b4c-b312-84778327a589 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:37.424068 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d3cd6f06-6be2-4b4c-b312-84778327a589 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:37.433675 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-d3cd6f06-6be2-4b4c-b312-84778327a589 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1370 microversion: 2.1 time: 0.182195 Jun 17 08:55:37.436735 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 301/609] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:37 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:37.503605 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-a41d6781-6613-44f1-989a-8865aa9e8f1f req-79924674-289c-4c31-9929-d41e824292c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eb89053-6d2e-47f4-a675-6254d182e074", "tag": "b987fec9-a409-4d3b-a983-64e04e498d92"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:55:37.516336 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-a41d6781-6613-44f1-989a-8865aa9e8f1f req-79924674-289c-4c31-9929-d41e824292c9 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:37.516819 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-a41d6781-6613-44f1-989a-8865aa9e8f1f req-79924674-289c-4c31-9929-d41e824292c9 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:37.529667 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-a41d6781-6613-44f1-989a-8865aa9e8f1f req-79924674-289c-4c31-9929-d41e824292c9 service nova] Creating event network-changed:b987fec9-a409-4d3b-a983-64e04e498d92 for instance 1eb89053-6d2e-47f4-a675-6254d182e074 on hv-cinder-79760 Jun 17 08:55:37.534637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-a41d6781-6613-44f1-989a-8865aa9e8f1f req-79924674-289c-4c31-9929-d41e824292c9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035498 Jun 17 08:55:37.535306 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 309/610] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:55:38.453983 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a39aa7bb-3569-4521-bb87-8073a25c07c9 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:38.454851 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-a39aa7bb-3569-4521-bb87-8073a25c07c9 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:38.463787 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a39aa7bb-3569-4521-bb87-8073a25c07c9 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:38.464233 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a39aa7bb-3569-4521-bb87-8073a25c07c9 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:38.465007 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a39aa7bb-3569-4521-bb87-8073a25c07c9 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:38.465437 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a39aa7bb-3569-4521-bb87-8073a25c07c9 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:38.599864 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a39aa7bb-3569-4521-bb87-8073a25c07c9 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:38.607228 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-a39aa7bb-3569-4521-bb87-8073a25c07c9 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1370 microversion: 2.1 time: 0.159717 Jun 17 08:55:38.607891 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 302/611] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:38 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:39.626511 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-9ed11184-9133-4914-bf80-fc9adca94949 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:39.627246 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-9ed11184-9133-4914-bf80-fc9adca94949 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:39.633998 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9ed11184-9133-4914-bf80-fc9adca94949 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:39.634465 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9ed11184-9133-4914-bf80-fc9adca94949 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:39.635221 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9ed11184-9133-4914-bf80-fc9adca94949 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:39.635710 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9ed11184-9133-4914-bf80-fc9adca94949 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:39.765157 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-9ed11184-9133-4914-bf80-fc9adca94949 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:39.773188 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-9ed11184-9133-4914-bf80-fc9adca94949 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1370 microversion: 2.1 time: 0.151682 Jun 17 08:55:39.773756 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 310/612] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:39 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:40.790953 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-4b290ebe-1e34-419f-a894-d9b60a3a990d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:40.791610 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-4b290ebe-1e34-419f-a894-d9b60a3a990d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:40.798989 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4b290ebe-1e34-419f-a894-d9b60a3a990d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:40.799471 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4b290ebe-1e34-419f-a894-d9b60a3a990d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:40.800247 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4b290ebe-1e34-419f-a894-d9b60a3a990d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:40.800828 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4b290ebe-1e34-419f-a894-d9b60a3a990d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:40.942946 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-4b290ebe-1e34-419f-a894-d9b60a3a990d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:40.950814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-4b290ebe-1e34-419f-a894-d9b60a3a990d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1370 microversion: 2.1 time: 0.164406 Jun 17 08:55:40.951445 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 303/613] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:40 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:55:41.969270 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-145058df-e9a1-420f-b3dc-a93e32a09df5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:41.969867 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-145058df-e9a1-420f-b3dc-a93e32a09df5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:41.976948 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-145058df-e9a1-420f-b3dc-a93e32a09df5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:41.977428 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-145058df-e9a1-420f-b3dc-a93e32a09df5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:41.978195 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-145058df-e9a1-420f-b3dc-a93e32a09df5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:41.978628 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-145058df-e9a1-420f-b3dc-a93e32a09df5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:42.112672 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-145058df-e9a1-420f-b3dc-a93e32a09df5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:42.120679 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-145058df-e9a1-420f-b3dc-a93e32a09df5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1370 microversion: 2.1 time: 0.155460 Jun 17 08:55:42.121246 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 311/614] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:41 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:55:43.136998 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-bb51d39a-90d3-4189-90dc-e0c946a995eb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:43.137602 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-bb51d39a-90d3-4189-90dc-e0c946a995eb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:43.144076 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bb51d39a-90d3-4189-90dc-e0c946a995eb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:43.144518 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bb51d39a-90d3-4189-90dc-e0c946a995eb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:43.145272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bb51d39a-90d3-4189-90dc-e0c946a995eb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:43.145701 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bb51d39a-90d3-4189-90dc-e0c946a995eb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:43.288604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-bb51d39a-90d3-4189-90dc-e0c946a995eb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:43.296555 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-bb51d39a-90d3-4189-90dc-e0c946a995eb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1370 microversion: 2.1 time: 0.163290 Jun 17 08:55:43.297183 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 304/615] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:43 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:44.313983 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-67e27131-4bc9-4e83-98dd-3729dc85e2ba tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:44.314671 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-67e27131-4bc9-4e83-98dd-3729dc85e2ba tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:44.317099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=2 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:44.322214 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-67e27131-4bc9-4e83-98dd-3729dc85e2ba tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:44.322663 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-67e27131-4bc9-4e83-98dd-3729dc85e2ba tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:44.323519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-67e27131-4bc9-4e83-98dd-3729dc85e2ba tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:44.323891 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-67e27131-4bc9-4e83-98dd-3729dc85e2ba tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:44.458135 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-67e27131-4bc9-4e83-98dd-3729dc85e2ba tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:44.465551 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-67e27131-4bc9-4e83-98dd-3729dc85e2ba tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1370 microversion: 2.1 time: 0.155540 Jun 17 08:55:44.466111 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 312/616] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:44 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:45.483378 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-eae59570-7e1f-424c-a4e9-287b72926f48 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:45.484001 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-eae59570-7e1f-424c-a4e9-287b72926f48 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:45.485970 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=2 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:45.486636 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=10 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:45.487904 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:45.493851 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eae59570-7e1f-424c-a4e9-287b72926f48 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:45.500268 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eae59570-7e1f-424c-a4e9-287b72926f48 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:45.500268 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eae59570-7e1f-424c-a4e9-287b72926f48 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:45.500268 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eae59570-7e1f-424c-a4e9-287b72926f48 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:45.628709 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-eae59570-7e1f-424c-a4e9-287b72926f48 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:45.636945 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-eae59570-7e1f-424c-a4e9-287b72926f48 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1370 microversion: 2.1 time: 0.157396 Jun 17 08:55:45.637524 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 305/617] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:45 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:46.654573 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-7ea360c8-5a8d-45a8-93b9-e98bc4e9c587 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:46.655221 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-7ea360c8-5a8d-45a8-93b9-e98bc4e9c587 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:46.661752 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7ea360c8-5a8d-45a8-93b9-e98bc4e9c587 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:46.662175 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7ea360c8-5a8d-45a8-93b9-e98bc4e9c587 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:46.662938 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7ea360c8-5a8d-45a8-93b9-e98bc4e9c587 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:46.663385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7ea360c8-5a8d-45a8-93b9-e98bc4e9c587 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:46.798516 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-7ea360c8-5a8d-45a8-93b9-e98bc4e9c587 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:46.807533 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-7ea360c8-5a8d-45a8-93b9-e98bc4e9c587 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1370 microversion: 2.1 time: 0.156716 Jun 17 08:55:46.808723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 313/618] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:46 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:47.825052 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3c8920a7-52ca-495f-bba9-e9f070a11853 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:47.825784 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-3c8920a7-52ca-495f-bba9-e9f070a11853 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:47.832563 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3c8920a7-52ca-495f-bba9-e9f070a11853 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:47.835867 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3c8920a7-52ca-495f-bba9-e9f070a11853 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:47.835867 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3c8920a7-52ca-495f-bba9-e9f070a11853 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:47.835867 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3c8920a7-52ca-495f-bba9-e9f070a11853 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:47.970415 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3c8920a7-52ca-495f-bba9-e9f070a11853 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:47.978428 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-3c8920a7-52ca-495f-bba9-e9f070a11853 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1370 microversion: 2.1 time: 0.157540 Jun 17 08:55:47.978999 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 306/619] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:47 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:48.996128 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-15a39ada-6f96-40a4-abd2-c782e280fd9e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:48.996742 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-15a39ada-6f96-40a4-abd2-c782e280fd9e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:49.000146 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_api:SELECT=54 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:49.003838 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-15a39ada-6f96-40a4-abd2-c782e280fd9e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:49.004292 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-15a39ada-6f96-40a4-abd2-c782e280fd9e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:49.005093 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-15a39ada-6f96-40a4-abd2-c782e280fd9e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:49.005520 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-15a39ada-6f96-40a4-abd2-c782e280fd9e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:49.134332 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-6eccbc9f-4a1a-47e7-8913-00a8d78171aa req-79341c3f-4e2e-4d3f-bc2e-cccccd17d019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb89053-6d2e-47f4-a675-6254d182e074", "name": "network-vif-plugged", "status": "completed", "tag": "b987fec9-a409-4d3b-a983-64e04e498d92"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:55:49.143271 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-6eccbc9f-4a1a-47e7-8913-00a8d78171aa req-79341c3f-4e2e-4d3f-bc2e-cccccd17d019 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:49.143753 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-6eccbc9f-4a1a-47e7-8913-00a8d78171aa req-79341c3f-4e2e-4d3f-bc2e-cccccd17d019 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:49.153171 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-15a39ada-6f96-40a4-abd2-c782e280fd9e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:49.155379 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-6eccbc9f-4a1a-47e7-8913-00a8d78171aa req-79341c3f-4e2e-4d3f-bc2e-cccccd17d019 service nova] Creating event network-vif-plugged:b987fec9-a409-4d3b-a983-64e04e498d92 for instance 1eb89053-6d2e-47f4-a675-6254d182e074 on hv-cinder-79760 Jun 17 08:55:49.160296 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-6eccbc9f-4a1a-47e7-8913-00a8d78171aa req-79341c3f-4e2e-4d3f-bc2e-cccccd17d019 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029992 Jun 17 08:55:49.160885 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 307/620] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:55:49.162576 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-15a39ada-6f96-40a4-abd2-c782e280fd9e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1370 microversion: 2.1 time: 0.169345 Jun 17 08:55:49.163176 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 314/621] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:48 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:50.181653 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-9bb4dd42-d387-43c2-9946-e7fad275a31a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:50.182353 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-9bb4dd42-d387-43c2-9946-e7fad275a31a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:50.188826 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9bb4dd42-d387-43c2-9946-e7fad275a31a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:50.189280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9bb4dd42-d387-43c2-9946-e7fad275a31a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:50.190053 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9bb4dd42-d387-43c2-9946-e7fad275a31a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:50.190494 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9bb4dd42-d387-43c2-9946-e7fad275a31a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:50.322762 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-9bb4dd42-d387-43c2-9946-e7fad275a31a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:50.328497 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-9bb4dd42-d387-43c2-9946-e7fad275a31a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1370 microversion: 2.1 time: 0.152422 Jun 17 08:55:50.329067 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 308/622] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:50 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:55:51.345902 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-f0ad1d18-a665-4b19-9718-b4c76a6800de tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:51.346524 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-f0ad1d18-a665-4b19-9718-b4c76a6800de tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:51.353144 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f0ad1d18-a665-4b19-9718-b4c76a6800de tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:51.353602 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f0ad1d18-a665-4b19-9718-b4c76a6800de tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:51.354376 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f0ad1d18-a665-4b19-9718-b4c76a6800de tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:51.354817 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f0ad1d18-a665-4b19-9718-b4c76a6800de tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:51.502077 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-f0ad1d18-a665-4b19-9718-b4c76a6800de tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:51.511330 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-f0ad1d18-a665-4b19-9718-b4c76a6800de tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1370 microversion: 2.1 time: 0.169203 Jun 17 08:55:51.514687 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 315/623] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:51 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:52.528501 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-5759e1d8-cdc4-4b76-a534-c4546bdc9b55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:52.529119 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-5759e1d8-cdc4-4b76-a534-c4546bdc9b55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:52.535708 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5759e1d8-cdc4-4b76-a534-c4546bdc9b55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:52.536165 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5759e1d8-cdc4-4b76-a534-c4546bdc9b55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:52.537654 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5759e1d8-cdc4-4b76-a534-c4546bdc9b55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:52.538107 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5759e1d8-cdc4-4b76-a534-c4546bdc9b55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:52.668636 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-5759e1d8-cdc4-4b76-a534-c4546bdc9b55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:52.676293 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-5759e1d8-cdc4-4b76-a534-c4546bdc9b55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1564 microversion: 2.1 time: 0.151620 Jun 17 08:55:52.676874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 309/624] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:52 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:52.699527 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-623f6f62-6632-4ae0-ad08-46a986fd7d55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:52.700070 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-623f6f62-6632-4ae0-ad08-46a986fd7d55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:52.706680 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-623f6f62-6632-4ae0-ad08-46a986fd7d55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:52.707058 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-623f6f62-6632-4ae0-ad08-46a986fd7d55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:52.707840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-623f6f62-6632-4ae0-ad08-46a986fd7d55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:52.708304 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-623f6f62-6632-4ae0-ad08-46a986fd7d55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:52.790851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-623f6f62-6632-4ae0-ad08-46a986fd7d55 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095295 Jun 17 08:55:52.791502 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 316/625] 10.222.0.78 () {58 vars in 1274 bytes} [Fri Jun 17 08:55:52 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:55:52.875016 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0911e1f5-e80f-4b36-bfd3-fe9a1d3d6574 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:52.875551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0911e1f5-e80f-4b36-bfd3-fe9a1d3d6574 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:52.881978 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0911e1f5-e80f-4b36-bfd3-fe9a1d3d6574 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:52.882500 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0911e1f5-e80f-4b36-bfd3-fe9a1d3d6574 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:52.883426 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0911e1f5-e80f-4b36-bfd3-fe9a1d3d6574 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:52.883872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0911e1f5-e80f-4b36-bfd3-fe9a1d3d6574 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:52.970544 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-0911e1f5-e80f-4b36-bfd3-fe9a1d3d6574 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lazy-loading 'services' on Instance uuid 3ab550e7-cda1-4950-a919-b651030c1083 {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:55:53.198120 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0911e1f5-e80f-4b36-bfd3-fe9a1d3d6574 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083/os-volume_attachments/3b581e24-9091-43d4-b12c-5c0c85f53b76" status: 202 len: 0 microversion: 2.1 time: 0.326843 Jun 17 08:55:53.199397 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 310/626] 10.222.0.78 () {58 vars in 1415 bytes} [Fri Jun 17 08:55:52 2022] DELETE /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083/os-volume_attachments/3b581e24-9091-43d4-b12c-5c0c85f53b76 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:55:54.100621 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-ac1d94a4-b94d-459d-8667-14b446a8d361 req-5a4b2f65-bad4-4588-a00e-75931140365b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eb89053-6d2e-47f4-a675-6254d182e074", "tag": "b987fec9-a409-4d3b-a983-64e04e498d92"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:55:54.109474 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-ac1d94a4-b94d-459d-8667-14b446a8d361 req-5a4b2f65-bad4-4588-a00e-75931140365b service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:54.110002 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-ac1d94a4-b94d-459d-8667-14b446a8d361 req-5a4b2f65-bad4-4588-a00e-75931140365b service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:54.122568 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-ac1d94a4-b94d-459d-8667-14b446a8d361 req-5a4b2f65-bad4-4588-a00e-75931140365b service nova] Creating event network-changed:b987fec9-a409-4d3b-a983-64e04e498d92 for instance 1eb89053-6d2e-47f4-a675-6254d182e074 on hv-cinder-79760 Jun 17 08:55:54.128173 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-ac1d94a4-b94d-459d-8667-14b446a8d361 req-5a4b2f65-bad4-4588-a00e-75931140365b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032412 Jun 17 08:55:54.128827 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 317/627] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:55:55.389776 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1aad694a-8775-4869-9745-919bca3a7627 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:55.390361 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-1aad694a-8775-4869-9745-919bca3a7627 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:55.398188 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1aad694a-8775-4869-9745-919bca3a7627 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:55.398859 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1aad694a-8775-4869-9745-919bca3a7627 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:55.399721 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1aad694a-8775-4869-9745-919bca3a7627 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:55.400163 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1aad694a-8775-4869-9745-919bca3a7627 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:55.434452 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-1aad694a-8775-4869-9745-919bca3a7627 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Going to try to terminate instance {{(pid=129875) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:55:55.580210 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:55.831607 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-1aad694a-8775-4869-9745-919bca3a7627 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 204 len: 0 microversion: 2.1 time: 0.445767 Jun 17 08:55:55.832343 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 311/628] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 08:55:55 2022] DELETE /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:55:55.841451 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-37cf9a7a-3f55-46c8-b109-9174f738ea12 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:55.842161 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-37cf9a7a-3f55-46c8-b109-9174f738ea12 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:55.849326 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-37cf9a7a-3f55-46c8-b109-9174f738ea12 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:55.849771 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-37cf9a7a-3f55-46c8-b109-9174f738ea12 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:55.850544 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-37cf9a7a-3f55-46c8-b109-9174f738ea12 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:55.850974 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-37cf9a7a-3f55-46c8-b109-9174f738ea12 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:55.995308 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-37cf9a7a-3f55-46c8-b109-9174f738ea12 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:56.002783 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-37cf9a7a-3f55-46c8-b109-9174f738ea12 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1512 microversion: 2.1 time: 0.165663 Jun 17 08:55:56.003370 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 318/629] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:55 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:57.021256 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-8f204bc4-e4b6-4f92-acd2-f138fb0b8447 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:57.021966 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-8f204bc4-e4b6-4f92-acd2-f138fb0b8447 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:57.029069 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8f204bc4-e4b6-4f92-acd2-f138fb0b8447 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:57.029513 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8f204bc4-e4b6-4f92-acd2-f138fb0b8447 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:57.030287 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8f204bc4-e4b6-4f92-acd2-f138fb0b8447 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:57.030718 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8f204bc4-e4b6-4f92-acd2-f138fb0b8447 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:57.163373 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-8f204bc4-e4b6-4f92-acd2-f138fb0b8447 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:57.170981 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-8f204bc4-e4b6-4f92-acd2-f138fb0b8447 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1512 microversion: 2.1 time: 0.153918 Jun 17 08:55:57.171760 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 312/630] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:57 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:58.189350 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-dbf6a5dd-e607-48b8-8eba-89504de76f4f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:58.189896 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-dbf6a5dd-e607-48b8-8eba-89504de76f4f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:58.197459 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dbf6a5dd-e607-48b8-8eba-89504de76f4f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:58.197906 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dbf6a5dd-e607-48b8-8eba-89504de76f4f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:58.198687 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dbf6a5dd-e607-48b8-8eba-89504de76f4f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:58.199121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dbf6a5dd-e607-48b8-8eba-89504de76f4f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:58.202231 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:58.346444 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-dbf6a5dd-e607-48b8-8eba-89504de76f4f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:58.356871 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-dbf6a5dd-e607-48b8-8eba-89504de76f4f tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1512 microversion: 2.1 time: 0.171406 Jun 17 08:55:58.357463 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 319/631] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:58 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:59.182662 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0cf3ca5b-fdd0-47ba-8510-087b02bcf507 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:59.183487 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0cf3ca5b-fdd0-47ba-8510-087b02bcf507 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:59.190283 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0cf3ca5b-fdd0-47ba-8510-087b02bcf507 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:59.190731 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0cf3ca5b-fdd0-47ba-8510-087b02bcf507 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:59.191542 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0cf3ca5b-fdd0-47ba-8510-087b02bcf507 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:59.191977 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0cf3ca5b-fdd0-47ba-8510-087b02bcf507 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:59.217595 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0cf3ca5b-fdd0-47ba-8510-087b02bcf507 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d/ips" status: 200 len: 149 microversion: 2.1 time: 0.038869 Jun 17 08:55:59.218905 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 313/632] 10.222.0.78 () {58 vars in 1247 bytes} [Fri Jun 17 08:55:59 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:55:59.230093 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-b4fb4c57-d179-46d0-88da-9fd3ad0d66a2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50996de5-7315-41a7-a05d-015e4d0c4ad1"}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:55:59.231254 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-b4fb4c57-d179-46d0-88da-9fd3ad0d66a2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:59.238663 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b4fb4c57-d179-46d0-88da-9fd3ad0d66a2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:59.239118 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b4fb4c57-d179-46d0-88da-9fd3ad0d66a2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:59.240017 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b4fb4c57-d179-46d0-88da-9fd3ad0d66a2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:59.240666 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b4fb4c57-d179-46d0-88da-9fd3ad0d66a2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:59.324833 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-b4fb4c57-d179-46d0-88da-9fd3ad0d66a2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] HTTP exception thrown: Invalid volume: volume 50996de5-7315-41a7-a05d-015e4d0c4ad1 is already attached to instances: 42469758-d2b8-4bde-92f6-0b7ef5528fbc Jun 17 08:55:59.326500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-b4fb4c57-d179-46d0-88da-9fd3ad0d66a2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Request method failure captured: Jun 17 08:55:59.326500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: POST /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d/os-volume_attachments HTTP/1.1 Jun 17 08:55:59.326500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:55:59.326500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:55:59.326500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:55:59.326500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 74 Jun 17 08:55:59.326500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:55:59.326500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:55:59.326500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:55:59.326500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:55:59.326500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirECoefK_2BxjZgVOeODeD0JulOcw4b3dCrWlpFY_cQoAEUxcK30AdtBELaLH-kVfcQ6VKJx7aLTz7Z0L639CzJLSrkIUHMaE3fnQwSThKfCgM9dozYdAIITDcNAYtXkDc4HYT-B7uJX_QV7RNcl_PdXigEFPXJ9IRk3STBItMRTcdRI Jun 17 08:55:59.326500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:55:59.326500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:55:59.326500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:55:59.326500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:55:59.326500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:55:59.326500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:55:59.326500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:55:59.326500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:55:59.326500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:55:59.326500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:55:59.328694 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}] Jun 17 08:55:59.328694 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:55:59.328694 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:55:59.328694 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:55:59.328694 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:55:59.328694 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:55:59.328694 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:55:59.328694 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: 01bb3df8b4b649388d1a0f6c24e18f1b Jun 17 08:55:59.328694 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:55:59.328694 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Jun 17 08:55:59.328694 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {"volumeAttachment": {"volumeId": "50996de5-7315-41a7-a05d-015e4d0c4ad1"}} Jun 17 08:55:59.328694 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 08:55:59.329584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Invalid volume: volume 50996de5-7315-41a7-a05d-015e4d0c4ad1 is already attached to instances: 42469758-d2b8-4bde-92f6-0b7ef5528fbc Jun 17 08:55:59.329584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'server_id': '4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d', 'body': {'volumeAttachment': {'volumeId': '50996de5-7315-41a7-a05d-015e4d0c4ad1'}}} Jun 17 08:55:59.329584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:55:59.329584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:55:59.329584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 17 08:55:59.329584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 17 08:55:59.329584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 08:55:59.329584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 08:55:59.329584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 08:55:59.329584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 08:55:59.329584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 17 08:55:59.329584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 17 08:55:59.329584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 17 08:55:59.329584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 17 08:55:59.329584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 50996de5-7315-41a7-a05d-015e4d0c4ad1 is already attached to instances: 42469758-d2b8-4bde-92f6-0b7ef5528fbc Jun 17 08:55:59.329584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:55:59.329584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:55:59.329584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:55:59.329584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:55:59.331018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:55:59.331018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:55:59.331018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:55:59.331018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:55:59.331018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:55:59.331018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:55:59.331018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 08:55:59.331018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 08:55:59.331018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 08:55:59.331018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 08:55:59.331018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 08:55:59.331018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 08:55:59.331018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 17 08:55:59.331018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 08:55:59.331018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 50996de5-7315-41a7-a05d-015e4d0c4ad1 is already attached to instances: 42469758-d2b8-4bde-92f6-0b7ef5528fbc Jun 17 08:55:59.331018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:55:59.331018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:55:59.331018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:55:59.331018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:55:59.331018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:55:59.332673 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:55:59.332673 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:55:59.332673 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:55:59.332673 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 50996de5-7315-41a7-a05d-015e4d0c4ad1 is already attached to instances: 42469758-d2b8-4bde-92f6-0b7ef5528fbc Jun 17 08:55:59.332673 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:55:59.332673 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-b4fb4c57-d179-46d0-88da-9fd3ad0d66a2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Returning 400 to user: Invalid volume: volume 50996de5-7315-41a7-a05d-015e4d0c4ad1 is already attached to instances: 42469758-d2b8-4bde-92f6-0b7ef5528fbc {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:55:59.332673 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-b4fb4c57-d179-46d0-88da-9fd3ad0d66a2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "POST /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101976 Jun 17 08:55:59.332673 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 320/633] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jun 17 08:55:59 2022] POST /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 08:55:59.339052 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-564a52df-6844-43a5-9d44-7fbf8e290315 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:59.339582 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-564a52df-6844-43a5-9d44-7fbf8e290315 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:59.345699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-564a52df-6844-43a5-9d44-7fbf8e290315 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:59.346145 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-564a52df-6844-43a5-9d44-7fbf8e290315 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:59.346908 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-564a52df-6844-43a5-9d44-7fbf8e290315 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:59.348903 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-564a52df-6844-43a5-9d44-7fbf8e290315 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:59.374454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-08f2e16f-38f6-4d39-9291-a7ead4b592d6 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:59.375087 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-08f2e16f-38f6-4d39-9291-a7ead4b592d6 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:59.382736 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-564a52df-6844-43a5-9d44-7fbf8e290315 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Going to try to terminate instance {{(pid=129875) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:55:59.383209 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-08f2e16f-38f6-4d39-9291-a7ead4b592d6 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:59.383710 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-08f2e16f-38f6-4d39-9291-a7ead4b592d6 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:59.385110 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-08f2e16f-38f6-4d39-9291-a7ead4b592d6 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:59.385110 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-08f2e16f-38f6-4d39-9291-a7ead4b592d6 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:59.454691 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-08f2e16f-38f6-4d39-9291-a7ead4b592d6 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:59.471613 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-08f2e16f-38f6-4d39-9291-a7ead4b592d6 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1470 microversion: 2.1 time: 0.101053 Jun 17 08:55:59.472236 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 321/634] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:59 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1470 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:59.526256 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-8cbd51f1-8271-4d91-88ab-96140b44771a req-4bc09317-754e-49aa-8bc4-986c2560ab05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ab550e7-cda1-4950-a919-b651030c1083", "name": "network-vif-deleted", "tag": "e561f750-e056-412b-80ea-540dd4045e2d"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:55:59.534440 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-8cbd51f1-8271-4d91-88ab-96140b44771a req-4bc09317-754e-49aa-8bc4-986c2560ab05 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:59.534885 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-8cbd51f1-8271-4d91-88ab-96140b44771a req-4bc09317-754e-49aa-8bc4-986c2560ab05 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:59.545628 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-8cbd51f1-8271-4d91-88ab-96140b44771a req-4bc09317-754e-49aa-8bc4-986c2560ab05 service nova] Creating event network-vif-deleted:e561f750-e056-412b-80ea-540dd4045e2d for instance 3ab550e7-cda1-4950-a919-b651030c1083 on hv-cinder-79760 Jun 17 08:55:59.550522 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-8cbd51f1-8271-4d91-88ab-96140b44771a req-4bc09317-754e-49aa-8bc4-986c2560ab05 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028159 Jun 17 08:55:59.551097 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 322/635] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:55:59.683473 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-564a52df-6844-43a5-9d44-7fbf8e290315 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 204 len: 0 microversion: 2.1 time: 0.346971 Jun 17 08:55:59.683621 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 314/636] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 08:55:59 2022] DELETE /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:55:59.692005 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-9a5742a3-1147-4ee9-9348-3fbc12e63e46 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:59.692822 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-9a5742a3-1147-4ee9-9348-3fbc12e63e46 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:59.699031 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9a5742a3-1147-4ee9-9348-3fbc12e63e46 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:59.699516 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9a5742a3-1147-4ee9-9348-3fbc12e63e46 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:59.700274 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9a5742a3-1147-4ee9-9348-3fbc12e63e46 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:59.700707 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9a5742a3-1147-4ee9-9348-3fbc12e63e46 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:59.840511 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-9a5742a3-1147-4ee9-9348-3fbc12e63e46 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:59.849516 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-9a5742a3-1147-4ee9-9348-3fbc12e63e46 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1681 microversion: 2.1 time: 0.160785 Jun 17 08:55:59.850834 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 323/637] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:59 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:00.495009 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-9223c8e7-1172-4478-9d59-2767f0ef9e8a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:00.495769 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-9223c8e7-1172-4478-9d59-2767f0ef9e8a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:00.502951 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9223c8e7-1172-4478-9d59-2767f0ef9e8a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:00.503382 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9223c8e7-1172-4478-9d59-2767f0ef9e8a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:00.504182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9223c8e7-1172-4478-9d59-2767f0ef9e8a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:00.504645 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9223c8e7-1172-4478-9d59-2767f0ef9e8a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:00.542836 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9223c8e7-1172-4478-9d59-2767f0ef9e8a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:00.543327 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9223c8e7-1172-4478-9d59-2767f0ef9e8a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:00.543820 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-9223c8e7-1172-4478-9d59-2767f0ef9e8a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lazy-loading 'fault' on Instance uuid 3ab550e7-cda1-4950-a919-b651030c1083 {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:56:00.595661 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-9223c8e7-1172-4478-9d59-2767f0ef9e8a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:00.609608 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-9223c8e7-1172-4478-9d59-2767f0ef9e8a tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1308 microversion: 2.1 time: 0.118587 Jun 17 08:56:00.610813 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 315/638] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:00 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1308 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:00.869014 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-7d364385-e0ab-442f-8f89-366ebb7163cf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:00.869636 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-7d364385-e0ab-442f-8f89-366ebb7163cf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:00.876404 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7d364385-e0ab-442f-8f89-366ebb7163cf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:00.876851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7d364385-e0ab-442f-8f89-366ebb7163cf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:00.877625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7d364385-e0ab-442f-8f89-366ebb7163cf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:00.878069 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7d364385-e0ab-442f-8f89-366ebb7163cf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:01.010080 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-7d364385-e0ab-442f-8f89-366ebb7163cf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:01.017792 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-7d364385-e0ab-442f-8f89-366ebb7163cf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1681 microversion: 2.1 time: 0.152750 Jun 17 08:56:01.018342 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 324/639] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:00 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:01.627599 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-4c214cdf-e4d8-424f-a5d2-ae45df13c54d tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:01.628310 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-4c214cdf-e4d8-424f-a5d2-ae45df13c54d tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:01.635293 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4c214cdf-e4d8-424f-a5d2-ae45df13c54d tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:01.635865 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4c214cdf-e4d8-424f-a5d2-ae45df13c54d tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:01.636630 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4c214cdf-e4d8-424f-a5d2-ae45df13c54d tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:01.637062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4c214cdf-e4d8-424f-a5d2-ae45df13c54d tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:01.669059 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4c214cdf-e4d8-424f-a5d2-ae45df13c54d tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:01.669503 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4c214cdf-e4d8-424f-a5d2-ae45df13c54d tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:01.670002 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-4c214cdf-e4d8-424f-a5d2-ae45df13c54d tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lazy-loading 'fault' on Instance uuid 3ab550e7-cda1-4950-a919-b651030c1083 {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:56:01.711461 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-4c214cdf-e4d8-424f-a5d2-ae45df13c54d tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f571731515754890874b862a1407ebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f8de28a0664821af43d9cdccab292d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:01.719086 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-4c214cdf-e4d8-424f-a5d2-ae45df13c54d tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 200 len: 1308 microversion: 2.1 time: 0.095572 Jun 17 08:56:01.719681 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 316/640] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:01 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:02.041132 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e5a8cfeb-22e0-4d59-8f4e-5dafcc7f10fd tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:02.041132 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-e5a8cfeb-22e0-4d59-8f4e-5dafcc7f10fd tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:02.047493 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e5a8cfeb-22e0-4d59-8f4e-5dafcc7f10fd tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:02.048839 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e5a8cfeb-22e0-4d59-8f4e-5dafcc7f10fd tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:02.050316 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e5a8cfeb-22e0-4d59-8f4e-5dafcc7f10fd tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:02.060924 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e5a8cfeb-22e0-4d59-8f4e-5dafcc7f10fd tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:02.234619 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e5a8cfeb-22e0-4d59-8f4e-5dafcc7f10fd tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:02.243396 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-e5a8cfeb-22e0-4d59-8f4e-5dafcc7f10fd tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1681 microversion: 2.1 time: 0.211355 Jun 17 08:56:02.243985 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 325/641] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:02 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1681 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:02.736961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-5d2e002a-49d2-4d81-b3cf-2af48dca33b5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:02.737536 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-5d2e002a-49d2-4d81-b3cf-2af48dca33b5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] [instance: 3ab550e7-cda1-4950-a919-b651030c1083] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:02.745335 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5d2e002a-49d2-4d81-b3cf-2af48dca33b5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:02.745933 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5d2e002a-49d2-4d81-b3cf-2af48dca33b5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:02.747284 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5d2e002a-49d2-4d81-b3cf-2af48dca33b5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:02.747761 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5d2e002a-49d2-4d81-b3cf-2af48dca33b5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:02.764933 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-5d2e002a-49d2-4d81-b3cf-2af48dca33b5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] HTTP exception thrown: Instance 3ab550e7-cda1-4950-a919-b651030c1083 could not be found. Jun 17 08:56:02.766859 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-5d2e002a-49d2-4d81-b3cf-2af48dca33b5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Request method failure captured: Jun 17 08:56:02.766859 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 HTTP/1.1 Jun 17 08:56:02.766859 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 08:56:02.766859 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 08:56:02.766859 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 08:56:02.766859 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 08:56:02.766859 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 08:56:02.766859 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 08:56:02.766859 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 08:56:02.766859 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 08:56:02.766859 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirEDoc7FUSMtcf542hpXJXXUTfvMnPlxZjfopeW7-XxYRtKNCaxpRUyLj-KWS2JeFUwmVpe-f0yRCNZwakqm-W_uhDmCf3E3l278edADspc7gC04YX22GrCukVJ71ud6dOqTK8wWGL9VBAMpY_yZXJcX7R6ptHCC79-iD1R-v_Fwwqt8 Jun 17 08:56:02.766859 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 08:56:02.766859 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 08:56:02.766859 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 08:56:02.766859 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 08:56:02.766859 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 08:56:02.766859 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 08:56:02.766859 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: 25f8de28a0664821af43d9cdccab292d Jun 17 08:56:02.766859 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1946185046 Jun 17 08:56:02.766859 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 08:56:02.766859 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 08:56:02.768424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/25f8de28a0664821af43d9cdccab292d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/25f8de28a0664821af43d9cdccab292d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_25f8de28a0664821af43d9cdccab292d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/25f8de28a0664821af43d9cdccab292d"}]}] Jun 17 08:56:02.768424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-VolumesSnapshotTestJSON-1946185046 Jun 17 08:56:02.768424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: 25f8de28a0664821af43d9cdccab292d Jun 17 08:56:02.768424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1946185046 Jun 17 08:56:02.768424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-VolumesSnapshotTestJSON-1946185046-project Jun 17 08:56:02.768424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 08:56:02.768424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 08:56:02.768424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: f571731515754890874b862a1407ebc0 Jun 17 08:56:02.768424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-VolumesSnapshotTestJSON-1946185046-project Jun 17 08:56:02.768424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: > Jun 17 08:56:02.768424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Instance 3ab550e7-cda1-4950-a919-b651030c1083 could not be found. Jun 17 08:56:02.768424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'id': '3ab550e7-cda1-4950-a919-b651030c1083'} Jun 17 08:56:02.772814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:56:02.772814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:56:02.772814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:56:02.772814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:56:02.772814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:56:02.772814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:56:02.772814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:56:02.772814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:56:02.772814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:56:02.772814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:56:02.772814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ab550e7-cda1-4950-a919-b651030c1083 could not be found. Jun 17 08:56:02.772814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:56:02.772814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:56:02.772814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:56:02.772814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:56:02.772814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:56:02.772814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:56:02.772814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:56:02.772814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:56:02.772814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:56:02.775280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:56:02.775280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:56:02.775280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:56:02.775280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:56:02.775280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:56:02.775280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:56:02.775280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:56:02.775280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ab550e7-cda1-4950-a919-b651030c1083 could not be found. Jun 17 08:56:02.775280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:56:02.775280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:56:02.775280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:56:02.775280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:56:02.775280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:56:02.775280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:56:02.775280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:56:02.775280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:56:02.775280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ab550e7-cda1-4950-a919-b651030c1083 could not be found. Jun 17 08:56:02.775280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:56:02.777351 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-5d2e002a-49d2-4d81-b3cf-2af48dca33b5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] Returning 404 to user: Instance 3ab550e7-cda1-4950-a919-b651030c1083 could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:56:02.777351 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-5d2e002a-49d2-4d81-b3cf-2af48dca33b5 tempest-VolumesSnapshotTestJSON-1946185046 tempest-VolumesSnapshotTestJSON-1946185046-project] 10.222.0.78 "GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083" status: 404 len: 111 microversion: 2.1 time: 0.036085 Jun 17 08:56:02.777351 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 317/642] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:02 2022] GET /compute/v2.1/servers/3ab550e7-cda1-4950-a919-b651030c1083 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:56:03.009971 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-d0df1361-16ce-4eee-b174-7d5ec5016efd req-9ac3be78-1144-4dc7-9f4f-d450d663c12f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d", "name": "network-vif-deleted", "tag": "865d7ab5-9d19-42eb-8363-e2eb81b9295c"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:56:03.020012 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-d0df1361-16ce-4eee-b174-7d5ec5016efd req-9ac3be78-1144-4dc7-9f4f-d450d663c12f service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:03.020414 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-d0df1361-16ce-4eee-b174-7d5ec5016efd req-9ac3be78-1144-4dc7-9f4f-d450d663c12f service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:03.037956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-d0df1361-16ce-4eee-b174-7d5ec5016efd req-9ac3be78-1144-4dc7-9f4f-d450d663c12f service nova] Creating event network-vif-deleted:865d7ab5-9d19-42eb-8363-e2eb81b9295c for instance 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d on hv-cinder-79760 Jun 17 08:56:03.055874 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-d0df1361-16ce-4eee-b174-7d5ec5016efd req-9ac3be78-1144-4dc7-9f4f-d450d663c12f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045214 Jun 17 08:56:03.058608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 326/643] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:56:03.263848 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-67e4f034-4f3c-41c3-b7d9-1b0f5660ab30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:03.264488 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-67e4f034-4f3c-41c3-b7d9-1b0f5660ab30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:03.271856 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-67e4f034-4f3c-41c3-b7d9-1b0f5660ab30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:03.272602 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-67e4f034-4f3c-41c3-b7d9-1b0f5660ab30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:03.273585 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-67e4f034-4f3c-41c3-b7d9-1b0f5660ab30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:03.274328 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-67e4f034-4f3c-41c3-b7d9-1b0f5660ab30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:03.364444 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-67e4f034-4f3c-41c3-b7d9-1b0f5660ab30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:03.389601 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-67e4f034-4f3c-41c3-b7d9-1b0f5660ab30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1327 microversion: 2.1 time: 0.130530 Jun 17 08:56:03.392873 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 318/644] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:03 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1327 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:56:04.412411 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-29686b13-a344-4000-9dab-45dda12dff30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:04.413126 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-29686b13-a344-4000-9dab-45dda12dff30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:04.420197 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-29686b13-a344-4000-9dab-45dda12dff30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:04.420644 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-29686b13-a344-4000-9dab-45dda12dff30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:04.421436 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-29686b13-a344-4000-9dab-45dda12dff30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:04.421872 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-29686b13-a344-4000-9dab-45dda12dff30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:04.464436 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-29686b13-a344-4000-9dab-45dda12dff30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:04.464436 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-29686b13-a344-4000-9dab-45dda12dff30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:04.464436 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.objects.instance [None req-29686b13-a344-4000-9dab-45dda12dff30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lazy-loading 'fault' on Instance uuid 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d {{(pid=129876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:56:04.533914 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-29686b13-a344-4000-9dab-45dda12dff30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:04.536238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-29686b13-a344-4000-9dab-45dda12dff30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 200 len: 1332 microversion: 2.1 time: 0.129821 Jun 17 08:56:04.536971 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 327/645] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:04 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 1332 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:05.553693 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1035edf2-29e4-4f46-8653-90495cdb3dbc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:05.554308 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-1035edf2-29e4-4f46-8653-90495cdb3dbc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:05.561000 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1035edf2-29e4-4f46-8653-90495cdb3dbc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:05.561450 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1035edf2-29e4-4f46-8653-90495cdb3dbc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:05.562221 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1035edf2-29e4-4f46-8653-90495cdb3dbc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:05.562661 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1035edf2-29e4-4f46-8653-90495cdb3dbc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:05.576048 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-1035edf2-29e4-4f46-8653-90495cdb3dbc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] HTTP exception thrown: Instance 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d could not be found. Jun 17 08:56:05.577620 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1035edf2-29e4-4f46-8653-90495cdb3dbc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Request method failure captured: Jun 17 08:56:05.577620 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d HTTP/1.1 Jun 17 08:56:05.577620 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 08:56:05.577620 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 08:56:05.577620 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 08:56:05.577620 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 08:56:05.577620 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 08:56:05.577620 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 08:56:05.577620 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 08:56:05.577620 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 08:56:05.577620 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirECoefK_2BxjZgVOeODeD0JulOcw4b3dCrWlpFY_cQoAEUxcK30AdtBELaLH-kVfcQ6VKJx7aLTz7Z0L639CzJLSrkIUHMaE3fnQwSThKfCgM9dozYdAIITDcNAYtXkDc4HYT-B7uJX_QV7RNcl_PdXigEFPXJ9IRk3STBItMRTcdRI Jun 17 08:56:05.577620 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 08:56:05.577620 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 08:56:05.577620 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 08:56:05.577620 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 08:56:05.577620 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 08:56:05.577620 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 08:56:05.577620 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:56:05.577620 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:56:05.577620 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 08:56:05.577620 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 08:56:05.579193 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}] Jun 17 08:56:05.579193 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:56:05.579193 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:56:05.579193 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:56:05.579193 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:56:05.579193 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 08:56:05.579193 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 08:56:05.579193 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: 01bb3df8b4b649388d1a0f6c24e18f1b Jun 17 08:56:05.579193 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:56:05.579193 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: > Jun 17 08:56:05.579193 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Instance 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d could not be found. Jun 17 08:56:05.579193 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'id': '4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d'} Jun 17 08:56:05.580570 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:56:05.580570 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:56:05.580570 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:56:05.580570 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:56:05.580570 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:56:05.580570 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:56:05.580570 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:56:05.580570 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:56:05.580570 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:56:05.580570 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:56:05.580570 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d could not be found. Jun 17 08:56:05.580570 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:56:05.580570 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:56:05.580570 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:56:05.580570 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:56:05.580570 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:56:05.580570 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:56:05.580570 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:56:05.580570 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:56:05.580570 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:56:05.582029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:56:05.582029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:56:05.582029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:56:05.582029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:56:05.582029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:56:05.582029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:56:05.582029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:56:05.582029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d could not be found. Jun 17 08:56:05.582029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:56:05.582029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:56:05.582029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:56:05.582029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:56:05.582029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:56:05.582029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:56:05.582029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:56:05.582029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:56:05.582029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d could not be found. Jun 17 08:56:05.582029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:56:05.584387 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1035edf2-29e4-4f46-8653-90495cdb3dbc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Returning 404 to user: Instance 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:56:05.584387 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-1035edf2-29e4-4f46-8653-90495cdb3dbc tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 404 len: 111 microversion: 2.1 time: 0.029223 Jun 17 08:56:05.584387 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 319/646] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:05 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:56:05.588536 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-51d1474c-c2f7-41a1-911f-661d6649bb88 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '.version_select at 0x7fbc33bc43a0>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:05.662024 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-51d1474c-c2f7-41a1-911f-661d6649bb88 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1088158492" status: 202 len: 0 microversion: 2.1 time: 0.076677 Jun 17 08:56:05.662678 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 328/647] 10.222.0.78 () {58 vars in 1220 bytes} [Fri Jun 17 08:56:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1088158492 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:56:06.515129 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-6978ffcc-63ad-4eea-964d-6d0b9cf12136 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:06.515676 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-6978ffcc-63ad-4eea-964d-6d0b9cf12136 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:06.522015 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6978ffcc-63ad-4eea-964d-6d0b9cf12136 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:06.522475 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6978ffcc-63ad-4eea-964d-6d0b9cf12136 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:06.523241 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6978ffcc-63ad-4eea-964d-6d0b9cf12136 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:06.523722 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6978ffcc-63ad-4eea-964d-6d0b9cf12136 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:06.602983 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-6978ffcc-63ad-4eea-964d-6d0b9cf12136 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lazy-loading 'services' on Instance uuid 42469758-d2b8-4bde-92f6-0b7ef5528fbc {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:56:06.853631 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-6978ffcc-63ad-4eea-964d-6d0b9cf12136 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "DELETE /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc/os-volume_attachments/50996de5-7315-41a7-a05d-015e4d0c4ad1" status: 202 len: 0 microversion: 2.1 time: 0.342218 Jun 17 08:56:06.854211 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 320/648] 10.222.0.78 () {58 vars in 1415 bytes} [Fri Jun 17 08:56:06 2022] DELETE /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc/os-volume_attachments/50996de5-7315-41a7-a05d-015e4d0c4ad1 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:56:06.864033 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-d2c94e2f-96ed-4ff2-9b2d-e9d48199ce2a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:06.865727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-d2c94e2f-96ed-4ff2-9b2d-e9d48199ce2a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:06.871794 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d2c94e2f-96ed-4ff2-9b2d-e9d48199ce2a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:06.872245 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d2c94e2f-96ed-4ff2-9b2d-e9d48199ce2a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:06.873026 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d2c94e2f-96ed-4ff2-9b2d-e9d48199ce2a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:06.873444 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d2c94e2f-96ed-4ff2-9b2d-e9d48199ce2a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:06.902898 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-d2c94e2f-96ed-4ff2-9b2d-e9d48199ce2a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044067 Jun 17 08:56:06.903403 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 329/649] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 08:56:06 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:56:07.915272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-67ca0107-c224-4212-86fd-b36fd8565e1b tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:07.916365 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-67ca0107-c224-4212-86fd-b36fd8565e1b tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:07.922605 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-67ca0107-c224-4212-86fd-b36fd8565e1b tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:07.923046 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-67ca0107-c224-4212-86fd-b36fd8565e1b tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:07.923830 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-67ca0107-c224-4212-86fd-b36fd8565e1b tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:07.924263 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-67ca0107-c224-4212-86fd-b36fd8565e1b tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:07.953840 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-67ca0107-c224-4212-86fd-b36fd8565e1b tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043305 Jun 17 08:56:07.954371 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 321/650] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 08:56:07 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:56:08.965386 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-08cd8f74-5e4b-4bc7-8392-76a44b3b18ae tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:08.966305 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-08cd8f74-5e4b-4bc7-8392-76a44b3b18ae tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:08.972574 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-08cd8f74-5e4b-4bc7-8392-76a44b3b18ae tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:08.973057 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-08cd8f74-5e4b-4bc7-8392-76a44b3b18ae tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:08.974359 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-08cd8f74-5e4b-4bc7-8392-76a44b3b18ae tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:08.974947 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-08cd8f74-5e4b-4bc7-8392-76a44b3b18ae tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:09.004566 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-08cd8f74-5e4b-4bc7-8392-76a44b3b18ae tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043096 Jun 17 08:56:09.005120 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 330/651] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 08:56:08 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:56:10.015917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d5b2c6d9-af13-4034-ad5c-c6d1289119ae tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:10.016895 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-d5b2c6d9-af13-4034-ad5c-c6d1289119ae tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:10.024576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d5b2c6d9-af13-4034-ad5c-c6d1289119ae tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:10.025029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d5b2c6d9-af13-4034-ad5c-c6d1289119ae tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:10.025806 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d5b2c6d9-af13-4034-ad5c-c6d1289119ae tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:10.026248 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d5b2c6d9-af13-4034-ad5c-c6d1289119ae tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:10.056403 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-d5b2c6d9-af13-4034-ad5c-c6d1289119ae tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044403 Jun 17 08:56:10.056983 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 322/652] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 08:56:10 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:56:10.938208 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-720d2fad-c6bb-4ca2-9cbc-ac99ce0e8abc tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:56:10.939152 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-720d2fad-c6bb-4ca2-9cbc-ac99ce0e8abc tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:10.946524 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-720d2fad-c6bb-4ca2-9cbc-ac99ce0e8abc tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:10.946969 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-720d2fad-c6bb-4ca2-9cbc-ac99ce0e8abc tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:10.947762 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-720d2fad-c6bb-4ca2-9cbc-ac99ce0e8abc tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:10.948194 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-720d2fad-c6bb-4ca2-9cbc-ac99ce0e8abc tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:11.069191 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-4b121d03-308f-4825-9ac4-b959c966d263 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:11.070140 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-4b121d03-308f-4825-9ac4-b959c966d263 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:11.076637 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4b121d03-308f-4825-9ac4-b959c966d263 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:11.077088 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4b121d03-308f-4825-9ac4-b959c966d263 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:11.077857 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4b121d03-308f-4825-9ac4-b959c966d263 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:11.078295 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4b121d03-308f-4825-9ac4-b959c966d263 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:11.108235 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-4b121d03-308f-4825-9ac4-b959c966d263 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043659 Jun 17 08:56:11.109002 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 323/653] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 08:56:11 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:56:11.166531 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-720d2fad-c6bb-4ca2-9cbc-ac99ce0e8abc tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "POST /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d/action" status: 202 len: 0 microversion: 2.1 time: 0.231949 Jun 17 08:56:11.167225 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 331/654] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jun 17 08:56:10 2022] POST /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:56:11.175657 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-7c61e4c5-0ce0-48c3-8da2-47d620cfb615 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:11.180938 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-7c61e4c5-0ce0-48c3-8da2-47d620cfb615 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:11.183403 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7c61e4c5-0ce0-48c3-8da2-47d620cfb615 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:11.183852 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7c61e4c5-0ce0-48c3-8da2-47d620cfb615 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:11.184604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7c61e4c5-0ce0-48c3-8da2-47d620cfb615 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:11.185037 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7c61e4c5-0ce0-48c3-8da2-47d620cfb615 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:11.329797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-7c61e4c5-0ce0-48c3-8da2-47d620cfb615 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:11.341009 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-7c61e4c5-0ce0-48c3-8da2-47d620cfb615 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1752 microversion: 2.1 time: 0.168578 Jun 17 08:56:11.352264 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 324/655] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:11 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:12.121950 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-978e1602-17c5-4b6a-9e1a-9e1fde4117aa tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:12.122861 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-978e1602-17c5-4b6a-9e1a-9e1fde4117aa tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:12.129256 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-978e1602-17c5-4b6a-9e1a-9e1fde4117aa tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:12.129859 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-978e1602-17c5-4b6a-9e1a-9e1fde4117aa tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:12.130561 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-978e1602-17c5-4b6a-9e1a-9e1fde4117aa tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:12.130999 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-978e1602-17c5-4b6a-9e1a-9e1fde4117aa tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:12.165371 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-978e1602-17c5-4b6a-9e1a-9e1fde4117aa tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048308 Jun 17 08:56:12.165960 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 332/656] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 08:56:12 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:56:12.358841 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-22179c99-dd4d-4c47-91a0-4964abc3bb96 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:12.359629 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-22179c99-dd4d-4c47-91a0-4964abc3bb96 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:12.367079 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-22179c99-dd4d-4c47-91a0-4964abc3bb96 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:12.367560 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-22179c99-dd4d-4c47-91a0-4964abc3bb96 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:12.368331 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-22179c99-dd4d-4c47-91a0-4964abc3bb96 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:12.368770 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-22179c99-dd4d-4c47-91a0-4964abc3bb96 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:12.523803 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-22179c99-dd4d-4c47-91a0-4964abc3bb96 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:12.532180 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-22179c99-dd4d-4c47-91a0-4964abc3bb96 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1757 microversion: 2.1 time: 0.177167 Jun 17 08:56:12.532753 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 325/657] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:12 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:13.178189 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-fd60aa5e-1391-4aac-9bd5-0cd82b9fd320 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:13.179139 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-fd60aa5e-1391-4aac-9bd5-0cd82b9fd320 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:13.186619 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fd60aa5e-1391-4aac-9bd5-0cd82b9fd320 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:13.187082 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fd60aa5e-1391-4aac-9bd5-0cd82b9fd320 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:13.187912 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fd60aa5e-1391-4aac-9bd5-0cd82b9fd320 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:13.188488 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fd60aa5e-1391-4aac-9bd5-0cd82b9fd320 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:13.222053 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-fd60aa5e-1391-4aac-9bd5-0cd82b9fd320 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048442 Jun 17 08:56:13.222832 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 333/658] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 08:56:13 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 08:56:13.286387 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-477aae14-66e6-4671-b09c-f1961c090b38 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:13.286901 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-477aae14-66e6-4671-b09c-f1961c090b38 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:13.293250 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-477aae14-66e6-4671-b09c-f1961c090b38 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:13.293693 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-477aae14-66e6-4671-b09c-f1961c090b38 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:13.294462 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-477aae14-66e6-4671-b09c-f1961c090b38 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:13.294888 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-477aae14-66e6-4671-b09c-f1961c090b38 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:13.321880 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-477aae14-66e6-4671-b09c-f1961c090b38 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Going to try to terminate instance {{(pid=129875) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:56:13.324930 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:13.550308 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-6af060cd-7792-4d6f-a905-968bd4ecbd0b tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:13.550914 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-6af060cd-7792-4d6f-a905-968bd4ecbd0b tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:13.556921 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6af060cd-7792-4d6f-a905-968bd4ecbd0b tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:13.557370 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6af060cd-7792-4d6f-a905-968bd4ecbd0b tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:13.558386 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6af060cd-7792-4d6f-a905-968bd4ecbd0b tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:13.558810 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6af060cd-7792-4d6f-a905-968bd4ecbd0b tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:13.701461 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-477aae14-66e6-4671-b09c-f1961c090b38 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "DELETE /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 204 len: 0 microversion: 2.1 time: 0.419258 Jun 17 08:56:13.702216 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 326/659] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 08:56:13 2022] DELETE /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:56:13.707251 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-6af060cd-7792-4d6f-a905-968bd4ecbd0b tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:13.711666 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-687fce5a-0f59-4775-8d9b-5fd18192edf8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:13.712471 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-687fce5a-0f59-4775-8d9b-5fd18192edf8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:13.716132 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-6af060cd-7792-4d6f-a905-968bd4ecbd0b tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1757 microversion: 2.1 time: 0.169694 Jun 17 08:56:13.716697 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 334/660] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:13 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:56:13.718803 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-687fce5a-0f59-4775-8d9b-5fd18192edf8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:13.719319 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-687fce5a-0f59-4775-8d9b-5fd18192edf8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:13.720315 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-687fce5a-0f59-4775-8d9b-5fd18192edf8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:13.720815 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-687fce5a-0f59-4775-8d9b-5fd18192edf8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:13.861861 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-687fce5a-0f59-4775-8d9b-5fd18192edf8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:13.871079 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-687fce5a-0f59-4775-8d9b-5fd18192edf8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1682 microversion: 2.1 time: 0.164407 Jun 17 08:56:13.871648 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 327/661] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:13 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:56:14.733404 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-3742a53d-10a6-4169-8206-04df3441adf1 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:14.734027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-3742a53d-10a6-4169-8206-04df3441adf1 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:14.741929 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3742a53d-10a6-4169-8206-04df3441adf1 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:14.741929 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3742a53d-10a6-4169-8206-04df3441adf1 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:14.742581 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3742a53d-10a6-4169-8206-04df3441adf1 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:14.743036 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3742a53d-10a6-4169-8206-04df3441adf1 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:14.889420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-3742a53d-10a6-4169-8206-04df3441adf1 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:14.891730 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d9e8f54a-9bc0-4b27-a215-07418713e3cf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:14.892348 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-d9e8f54a-9bc0-4b27-a215-07418713e3cf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:14.898136 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-3742a53d-10a6-4169-8206-04df3441adf1 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1757 microversion: 2.1 time: 0.168533 Jun 17 08:56:14.902018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 335/662] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:14 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:14.902387 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d9e8f54a-9bc0-4b27-a215-07418713e3cf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:14.902387 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d9e8f54a-9bc0-4b27-a215-07418713e3cf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:14.902387 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d9e8f54a-9bc0-4b27-a215-07418713e3cf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:14.902387 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d9e8f54a-9bc0-4b27-a215-07418713e3cf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:15.049049 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d9e8f54a-9bc0-4b27-a215-07418713e3cf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:15.056910 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-d9e8f54a-9bc0-4b27-a215-07418713e3cf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1682 microversion: 2.1 time: 0.169500 Jun 17 08:56:15.057468 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 328/663] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:14 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:56:15.920997 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-6f3cc718-20f7-4735-a44a-7e573f14fd44 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:15.922191 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-6f3cc718-20f7-4735-a44a-7e573f14fd44 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:15.929679 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6f3cc718-20f7-4735-a44a-7e573f14fd44 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:15.930138 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6f3cc718-20f7-4735-a44a-7e573f14fd44 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:15.930921 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6f3cc718-20f7-4735-a44a-7e573f14fd44 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:15.931381 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6f3cc718-20f7-4735-a44a-7e573f14fd44 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:16.076079 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-c839501c-4030-421a-918c-42a2ad7d8cfd tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:16.077695 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-c839501c-4030-421a-918c-42a2ad7d8cfd tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:16.087518 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=3 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:16.089707 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c839501c-4030-421a-918c-42a2ad7d8cfd tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:16.093805 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-6f3cc718-20f7-4735-a44a-7e573f14fd44 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:16.095873 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c839501c-4030-421a-918c-42a2ad7d8cfd tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:16.096738 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c839501c-4030-421a-918c-42a2ad7d8cfd tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:16.096869 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:16.100164 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c839501c-4030-421a-918c-42a2ad7d8cfd tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:16.105390 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-6f3cc718-20f7-4735-a44a-7e573f14fd44 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1757 microversion: 2.1 time: 0.188291 Jun 17 08:56:16.115750 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 336/664] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:15 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:16.267323 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c839501c-4030-421a-918c-42a2ad7d8cfd tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:16.277798 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-c839501c-4030-421a-918c-42a2ad7d8cfd tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1682 microversion: 2.1 time: 0.207092 Jun 17 08:56:16.278408 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 329/665] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:16 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1682 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:56:17.123399 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-88a843ac-8691-4602-971f-a2c92e22849f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:17.124347 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-88a843ac-8691-4602-971f-a2c92e22849f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:17.133487 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-88a843ac-8691-4602-971f-a2c92e22849f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:17.134042 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-88a843ac-8691-4602-971f-a2c92e22849f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:17.135306 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-88a843ac-8691-4602-971f-a2c92e22849f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:17.135934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-88a843ac-8691-4602-971f-a2c92e22849f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:17.144669 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-798b81f4-0a44-4091-8ec3-ec6b388ae45b req-e3e8bdaf-6acf-4cf9-9f4d-b872320763df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42469758-d2b8-4bde-92f6-0b7ef5528fbc", "name": "network-vif-deleted", "tag": "62eb07ca-d310-44bf-a6bd-62e5e42d4403"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:56:17.154278 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-798b81f4-0a44-4091-8ec3-ec6b388ae45b req-e3e8bdaf-6acf-4cf9-9f4d-b872320763df service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:17.154725 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-798b81f4-0a44-4091-8ec3-ec6b388ae45b req-e3e8bdaf-6acf-4cf9-9f4d-b872320763df service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:17.167574 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-798b81f4-0a44-4091-8ec3-ec6b388ae45b req-e3e8bdaf-6acf-4cf9-9f4d-b872320763df service nova] Creating event network-vif-deleted:62eb07ca-d310-44bf-a6bd-62e5e42d4403 for instance 42469758-d2b8-4bde-92f6-0b7ef5528fbc on hv-cinder-79760 Jun 17 08:56:17.172544 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-798b81f4-0a44-4091-8ec3-ec6b388ae45b req-e3e8bdaf-6acf-4cf9-9f4d-b872320763df service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032008 Jun 17 08:56:17.173141 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 330/666] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:56:17.299164 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-fda1dd26-3a13-48e1-92f0-bcea74a5871e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:17.300021 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-fda1dd26-3a13-48e1-92f0-bcea74a5871e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:17.307385 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fda1dd26-3a13-48e1-92f0-bcea74a5871e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:17.308547 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fda1dd26-3a13-48e1-92f0-bcea74a5871e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:17.310536 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fda1dd26-3a13-48e1-92f0-bcea74a5871e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:17.311156 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fda1dd26-3a13-48e1-92f0-bcea74a5871e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:17.327641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-88a843ac-8691-4602-971f-a2c92e22849f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:17.337634 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-88a843ac-8691-4602-971f-a2c92e22849f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1757 microversion: 2.1 time: 0.218051 Jun 17 08:56:17.347659 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 337/667] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:17 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1757 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:17.383186 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-fda1dd26-3a13-48e1-92f0-bcea74a5871e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:17.391981 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-fda1dd26-3a13-48e1-92f0-bcea74a5871e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1614 microversion: 2.1 time: 0.097137 Jun 17 08:56:17.399502 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 331/668] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:17 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1614 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:56:18.355781 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-35eb7d51-a0ee-410c-a267-e0b112dd1a46 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:18.356412 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-35eb7d51-a0ee-410c-a267-e0b112dd1a46 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:18.363373 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-35eb7d51-a0ee-410c-a267-e0b112dd1a46 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:18.363852 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-35eb7d51-a0ee-410c-a267-e0b112dd1a46 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:18.364649 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-35eb7d51-a0ee-410c-a267-e0b112dd1a46 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:18.365167 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-35eb7d51-a0ee-410c-a267-e0b112dd1a46 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:18.409646 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-b85c0fb5-e6fd-4eb5-8bd8-b87c3fbf4e9d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:18.410279 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-b85c0fb5-e6fd-4eb5-8bd8-b87c3fbf4e9d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:18.417912 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b85c0fb5-e6fd-4eb5-8bd8-b87c3fbf4e9d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:18.418361 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b85c0fb5-e6fd-4eb5-8bd8-b87c3fbf4e9d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:18.419174 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b85c0fb5-e6fd-4eb5-8bd8-b87c3fbf4e9d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:18.419637 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b85c0fb5-e6fd-4eb5-8bd8-b87c3fbf4e9d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:18.491971 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b85c0fb5-e6fd-4eb5-8bd8-b87c3fbf4e9d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:18.499718 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-b85c0fb5-e6fd-4eb5-8bd8-b87c3fbf4e9d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1614 microversion: 2.1 time: 0.094135 Jun 17 08:56:18.500304 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 332/669] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:18 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1614 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:18.540307 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-35eb7d51-a0ee-410c-a267-e0b112dd1a46 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:18.548184 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-35eb7d51-a0ee-410c-a267-e0b112dd1a46 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1757 microversion: 2.1 time: 0.196460 Jun 17 08:56:18.548745 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 338/670] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:18 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1757 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:19.516617 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-585015e5-afc5-499f-b122-8a3c9d218a5a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:19.517366 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-585015e5-afc5-499f-b122-8a3c9d218a5a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:19.525365 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-585015e5-afc5-499f-b122-8a3c9d218a5a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:19.529189 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-585015e5-afc5-499f-b122-8a3c9d218a5a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:19.529189 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-585015e5-afc5-499f-b122-8a3c9d218a5a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:19.529189 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-585015e5-afc5-499f-b122-8a3c9d218a5a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:19.564875 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-2430b91c-5235-4189-85f9-663e188675ef tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:19.565484 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-2430b91c-5235-4189-85f9-663e188675ef tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:19.568381 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:19.573200 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2430b91c-5235-4189-85f9-663e188675ef tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:19.573662 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2430b91c-5235-4189-85f9-663e188675ef tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:19.574430 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2430b91c-5235-4189-85f9-663e188675ef tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:19.574870 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2430b91c-5235-4189-85f9-663e188675ef tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:19.593029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-585015e5-afc5-499f-b122-8a3c9d218a5a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:19.601827 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-585015e5-afc5-499f-b122-8a3c9d218a5a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 200 len: 1326 microversion: 2.1 time: 0.089083 Jun 17 08:56:19.605744 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 333/671] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:19 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 1326 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:56:19.726353 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-2430b91c-5235-4189-85f9-663e188675ef tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:19.735027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-2430b91c-5235-4189-85f9-663e188675ef tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1757 microversion: 2.1 time: 0.173664 Jun 17 08:56:19.735637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 339/672] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:19 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:56:20.618533 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-39af57b9-6c24-4755-b714-04d401e360f3 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:20.619133 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-39af57b9-6c24-4755-b714-04d401e360f3 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:20.625834 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-39af57b9-6c24-4755-b714-04d401e360f3 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:20.626277 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-39af57b9-6c24-4755-b714-04d401e360f3 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:20.627039 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-39af57b9-6c24-4755-b714-04d401e360f3 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:20.627560 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-39af57b9-6c24-4755-b714-04d401e360f3 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:20.641316 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-39af57b9-6c24-4755-b714-04d401e360f3 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] HTTP exception thrown: Instance 42469758-d2b8-4bde-92f6-0b7ef5528fbc could not be found. Jun 17 08:56:20.642948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-39af57b9-6c24-4755-b714-04d401e360f3 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Request method failure captured: Jun 17 08:56:20.642948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc HTTP/1.1 Jun 17 08:56:20.642948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 08:56:20.642948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 08:56:20.642948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 08:56:20.642948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 08:56:20.642948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 08:56:20.642948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 08:56:20.642948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 08:56:20.642948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 08:56:20.642948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirECoefK_2BxjZgVOeODeD0JulOcw4b3dCrWlpFY_cQoAEUxcK30AdtBELaLH-kVfcQ6VKJx7aLTz7Z0L639CzJLSrkIUHMaE3fnQwSThKfCgM9dozYdAIITDcNAYtXkDc4HYT-B7uJX_QV7RNcl_PdXigEFPXJ9IRk3STBItMRTcdRI Jun 17 08:56:20.642948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 08:56:20.642948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 08:56:20.642948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 08:56:20.642948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 08:56:20.642948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 08:56:20.642948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 08:56:20.642948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:56:20.642948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:56:20.642948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 08:56:20.642948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 08:56:20.644401 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}] Jun 17 08:56:20.644401 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:56:20.644401 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:56:20.644401 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:56:20.644401 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:56:20.644401 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 08:56:20.644401 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 08:56:20.644401 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: 01bb3df8b4b649388d1a0f6c24e18f1b Jun 17 08:56:20.644401 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:56:20.644401 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: > Jun 17 08:56:20.644401 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Instance 42469758-d2b8-4bde-92f6-0b7ef5528fbc could not be found. Jun 17 08:56:20.644401 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'id': '42469758-d2b8-4bde-92f6-0b7ef5528fbc'} Jun 17 08:56:20.645783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:56:20.645783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:56:20.645783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:56:20.645783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:56:20.645783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:56:20.645783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:56:20.645783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:56:20.645783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:56:20.645783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:56:20.645783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:56:20.645783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42469758-d2b8-4bde-92f6-0b7ef5528fbc could not be found. Jun 17 08:56:20.645783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:56:20.645783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:56:20.645783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:56:20.645783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:56:20.645783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:56:20.645783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:56:20.645783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:56:20.645783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:56:20.645783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:56:20.647285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:56:20.647285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:56:20.647285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:56:20.647285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:56:20.647285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:56:20.647285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:56:20.647285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:56:20.647285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42469758-d2b8-4bde-92f6-0b7ef5528fbc could not be found. Jun 17 08:56:20.647285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:56:20.647285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:56:20.647285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:56:20.647285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:56:20.647285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:56:20.647285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:56:20.647285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:56:20.647285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:56:20.647285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42469758-d2b8-4bde-92f6-0b7ef5528fbc could not be found. Jun 17 08:56:20.647285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:56:20.648731 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-39af57b9-6c24-4755-b714-04d401e360f3 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Returning 404 to user: Instance 42469758-d2b8-4bde-92f6-0b7ef5528fbc could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:56:20.648731 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-39af57b9-6c24-4755-b714-04d401e360f3 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 404 len: 111 microversion: 2.1 time: 0.029970 Jun 17 08:56:20.648731 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 334/673] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:20 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:56:20.653917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-469e82e6-3509-4b63-b6ae-2cb9f465abc5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '.version_select at 0x7fbc33c174c0>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:20.729350 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-469e82e6-3509-4b63-b6ae-2cb9f465abc5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109878213" status: 202 len: 0 microversion: 2.1 time: 0.079225 Jun 17 08:56:20.729934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 340/674] 10.222.0.78 () {58 vars in 1220 bytes} [Fri Jun 17 08:56:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109878213 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:56:20.752935 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-e2727532-b715-4a09-894f-de4e7186dd18 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:20.753654 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-e2727532-b715-4a09-894f-de4e7186dd18 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:20.760461 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e2727532-b715-4a09-894f-de4e7186dd18 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:20.760933 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e2727532-b715-4a09-894f-de4e7186dd18 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:20.761711 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e2727532-b715-4a09-894f-de4e7186dd18 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:20.762140 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e2727532-b715-4a09-894f-de4e7186dd18 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:20.966264 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-e2727532-b715-4a09-894f-de4e7186dd18 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:20.974946 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-e2727532-b715-4a09-894f-de4e7186dd18 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1757 microversion: 2.1 time: 0.226258 Jun 17 08:56:20.975584 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 335/675] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:20 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1757 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:21.647774 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-c7fcc78e-475f-46b3-a5a8-cb4354400bc3 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Action: 'create', calling method: .version_select at 0x7fbc33b5c550>, body: {"keypair": {"name": "tempest-keypair-2080434707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTPN4D/jHt4gu/rhoAQNmIpeaR4XC3JkwKduYk2QBxaySLdaSg/hQgyrBmH9ydI+dzB++GdDB55Zeb8piCbUBO9ZgYUIaPdgMZshztwjhUcE/4vyuhouaY1XRn4jkeaAQ=="}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:56:21.664745 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-c7fcc78e-475f-46b3-a5a8-cb4354400bc3 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Getting quotas for project 794e7ebcf5c3436081b8e8d39907b655. Resources: {'key_pairs'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:56:21.668671 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-c7fcc78e-475f-46b3-a5a8-cb4354400bc3 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Getting quotas for user 01bb3df8b4b649388d1a0f6c24e18f1b and project 794e7ebcf5c3436081b8e8d39907b655. Resources: {'key_pairs'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:56:21.741536 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-c7fcc78e-475f-46b3-a5a8-cb4354400bc3 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.097733 Jun 17 08:56:21.742143 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 341/676] 10.222.0.78 () {60 vars in 1158 bytes} [Fri Jun 17 08:56:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:56:21.993143 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a94ac924-46c8-4340-87a7-24a021c8da6c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:21.993680 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-a94ac924-46c8-4340-87a7-24a021c8da6c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:22.000110 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a94ac924-46c8-4340-87a7-24a021c8da6c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:22.000555 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a94ac924-46c8-4340-87a7-24a021c8da6c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:22.001318 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a94ac924-46c8-4340-87a7-24a021c8da6c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:22.001759 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a94ac924-46c8-4340-87a7-24a021c8da6c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:22.154904 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a94ac924-46c8-4340-87a7-24a021c8da6c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:22.161962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-a94ac924-46c8-4340-87a7-24a021c8da6c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1757 microversion: 2.1 time: 0.173331 Jun 17 08:56:22.162545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 336/677] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:21 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:23.181030 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-6a778635-679d-4a93-8659-19519c155ea8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:23.181776 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-6a778635-679d-4a93-8659-19519c155ea8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:23.188265 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6a778635-679d-4a93-8659-19519c155ea8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:23.188847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6a778635-679d-4a93-8659-19519c155ea8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:23.189841 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6a778635-679d-4a93-8659-19519c155ea8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:23.190218 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6a778635-679d-4a93-8659-19519c155ea8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:23.342754 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-6a778635-679d-4a93-8659-19519c155ea8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:23.352585 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-6a778635-679d-4a93-8659-19519c155ea8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1757 microversion: 2.1 time: 0.176928 Jun 17 08:56:23.353240 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 342/678] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:23 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:24.069726 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-79dc6494-d073-443e-90a1-f883b28bd7da tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-374614363", "imageRef": "978084c7-ed2c-4e42-ac8b-f5d19c4001fe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5af04e5-5681-4034-bf01-a7f9807128a2"}], "security_groups": [{"name": "tempest-securitygroup--258190682"}], "key_name": "tempest-keypair-2080434707", "user_data": "}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:56:24.171028 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.network.neutron [None req-79dc6494-d073-443e-90a1-f883b28bd7da tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] validate_networks() for [('b5af04e5-5681-4034-bf01-a7f9807128a2', None, None, None, None, None)] {{(pid=129875) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:56:24.369701 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-1e14dc0e-f47a-4384-bf2c-20d4b8fd7680 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:24.370979 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-1e14dc0e-f47a-4384-bf2c-20d4b8fd7680 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:24.377607 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1e14dc0e-f47a-4384-bf2c-20d4b8fd7680 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:24.378056 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1e14dc0e-f47a-4384-bf2c-20d4b8fd7680 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:24.378824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1e14dc0e-f47a-4384-bf2c-20d4b8fd7680 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:24.380042 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1e14dc0e-f47a-4384-bf2c-20d4b8fd7680 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:24.604629 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-1e14dc0e-f47a-4384-bf2c-20d4b8fd7680 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:24.613075 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-1e14dc0e-f47a-4384-bf2c-20d4b8fd7680 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1757 microversion: 2.1 time: 0.247194 Jun 17 08:56:24.623275 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 343/679] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:24 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1757 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:56:24.624281 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-79dc6494-d073-443e-90a1-f883b28bd7da tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Flavor limits 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:56:24.624713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-79dc6494-d073-443e-90a1-f883b28bd7da tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Image limits 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:56:24.625206 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-79dc6494-d073-443e-90a1-f883b28bd7da tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Flavor pref 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:56:24.625599 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-79dc6494-d073-443e-90a1-f883b28bd7da tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Image pref 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:56:24.626013 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-79dc6494-d073-443e-90a1-f883b28bd7da tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:56:24.635549 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-79dc6494-d073-443e-90a1-f883b28bd7da tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:24.635998 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-79dc6494-d073-443e-90a1-f883b28bd7da tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:24.636797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-79dc6494-d073-443e-90a1-f883b28bd7da tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:24.637234 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-79dc6494-d073-443e-90a1-f883b28bd7da tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:24.654496 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-79dc6494-d073-443e-90a1-f883b28bd7da tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Getting quotas for project 794e7ebcf5c3436081b8e8d39907b655. Resources: {'ram', 'cores', 'instances'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:56:24.658211 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-79dc6494-d073-443e-90a1-f883b28bd7da tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Getting quotas for user 01bb3df8b4b649388d1a0f6c24e18f1b and project 794e7ebcf5c3436081b8e8d39907b655. Resources: {'ram', 'cores', 'instances'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:56:24.670348 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-79dc6494-d073-443e-90a1-f883b28bd7da tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Going to run 1 instances... {{(pid=129875) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:56:24.674664 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-79dc6494-d073-443e-90a1-f883b28bd7da tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='978084c7-ed2c-4e42-ac8b-f5d19c4001fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:56:24.781242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-79dc6494-d073-443e-90a1-f883b28bd7da tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.715932 Jun 17 08:56:24.781933 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 337/680] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jun 17 08:56:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:56:24.792584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-f281c54c-6fdb-4518-a951-252f9956cccf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:24.793183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-f281c54c-6fdb-4518-a951-252f9956cccf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:24.856173 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-f281c54c-6fdb-4518-a951-252f9956cccf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:24.864573 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-f281c54c-6fdb-4518-a951-252f9956cccf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964" status: 200 len: 1241 microversion: 2.1 time: 0.075212 Jun 17 08:56:24.874425 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 344/681] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:24 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:25.631112 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-26cfad69-e586-432b-abc6-616a44282929 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:25.631780 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-26cfad69-e586-432b-abc6-616a44282929 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:25.638672 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-26cfad69-e586-432b-abc6-616a44282929 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:25.639117 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-26cfad69-e586-432b-abc6-616a44282929 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:25.639916 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-26cfad69-e586-432b-abc6-616a44282929 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:25.640347 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-26cfad69-e586-432b-abc6-616a44282929 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:25.799065 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-26cfad69-e586-432b-abc6-616a44282929 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:25.808419 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-26cfad69-e586-432b-abc6-616a44282929 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1757 microversion: 2.1 time: 0.181519 Jun 17 08:56:25.809073 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 338/682] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:25 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:25.881527 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-bb84978a-28ec-4587-a8b5-2c7266a78f9e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:25.882152 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-bb84978a-28ec-4587-a8b5-2c7266a78f9e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:25.889268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bb84978a-28ec-4587-a8b5-2c7266a78f9e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:25.889727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bb84978a-28ec-4587-a8b5-2c7266a78f9e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:25.890513 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bb84978a-28ec-4587-a8b5-2c7266a78f9e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:25.891339 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bb84978a-28ec-4587-a8b5-2c7266a78f9e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:25.964112 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-bb84978a-28ec-4587-a8b5-2c7266a78f9e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:25.972355 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-bb84978a-28ec-4587-a8b5-2c7266a78f9e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964" status: 200 len: 1245 microversion: 2.1 time: 0.094680 Jun 17 08:56:25.982330 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 345/683] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:25 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:26.825982 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-eda18c0e-dc05-45d6-ac52-f843f2b36417 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:26.826577 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-eda18c0e-dc05-45d6-ac52-f843f2b36417 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:26.833635 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eda18c0e-dc05-45d6-ac52-f843f2b36417 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:26.834092 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eda18c0e-dc05-45d6-ac52-f843f2b36417 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:26.834905 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eda18c0e-dc05-45d6-ac52-f843f2b36417 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:26.835343 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eda18c0e-dc05-45d6-ac52-f843f2b36417 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:26.987970 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-eda18c0e-dc05-45d6-ac52-f843f2b36417 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:26.994704 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-f90b6966-edbb-407e-b9bf-c6d2b119ac4e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:26.995958 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-f90b6966-edbb-407e-b9bf-c6d2b119ac4e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:26.997792 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-eda18c0e-dc05-45d6-ac52-f843f2b36417 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1757 microversion: 2.1 time: 0.175619 Jun 17 08:56:26.998386 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 339/684] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:26 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:27.016548 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f90b6966-edbb-407e-b9bf-c6d2b119ac4e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:27.017015 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f90b6966-edbb-407e-b9bf-c6d2b119ac4e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:27.017797 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f90b6966-edbb-407e-b9bf-c6d2b119ac4e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:27.018237 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f90b6966-edbb-407e-b9bf-c6d2b119ac4e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:27.099701 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-f90b6966-edbb-407e-b9bf-c6d2b119ac4e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:27.107798 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-f90b6966-edbb-407e-b9bf-c6d2b119ac4e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964" status: 200 len: 1301 microversion: 2.1 time: 0.121408 Jun 17 08:56:27.108492 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 346/685] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:26 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 => generated 1301 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:28.015078 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-6df2aeb7-ae71-4fd2-811b-e7b8b16e32ae tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:28.015833 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-6df2aeb7-ae71-4fd2-811b-e7b8b16e32ae tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:28.023452 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6df2aeb7-ae71-4fd2-811b-e7b8b16e32ae tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:28.023903 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6df2aeb7-ae71-4fd2-811b-e7b8b16e32ae tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:28.024680 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6df2aeb7-ae71-4fd2-811b-e7b8b16e32ae tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:28.025114 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6df2aeb7-ae71-4fd2-811b-e7b8b16e32ae tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:28.126749 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a07419f4-c53d-4cbc-a662-1b9b5f9f6cb2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:28.127990 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a07419f4-c53d-4cbc-a662-1b9b5f9f6cb2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:28.136581 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a07419f4-c53d-4cbc-a662-1b9b5f9f6cb2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:28.137919 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a07419f4-c53d-4cbc-a662-1b9b5f9f6cb2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:28.138946 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a07419f4-c53d-4cbc-a662-1b9b5f9f6cb2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:28.140184 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a07419f4-c53d-4cbc-a662-1b9b5f9f6cb2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:28.201545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-6df2aeb7-ae71-4fd2-811b-e7b8b16e32ae tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:28.211076 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-6df2aeb7-ae71-4fd2-811b-e7b8b16e32ae tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1757 microversion: 2.1 time: 0.200118 Jun 17 08:56:28.212144 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 340/686] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:28 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1757 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:28.293495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a07419f4-c53d-4cbc-a662-1b9b5f9f6cb2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:28.301207 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a07419f4-c53d-4cbc-a662-1b9b5f9f6cb2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964" status: 200 len: 1366 microversion: 2.1 time: 0.179370 Jun 17 08:56:28.301789 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 347/687] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:28 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:28.908580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-1ffac12e-f84d-4eed-834a-c05b7c3fd42b req-7303e2eb-94b3-4616-ac88-531ffcf37dbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fab8f2eb-71c8-4956-b693-06f73bf86964", "tag": "115b315e-aa00-4ff6-9273-ebeabdd14b26"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:56:28.917659 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-1ffac12e-f84d-4eed-834a-c05b7c3fd42b req-7303e2eb-94b3-4616-ac88-531ffcf37dbf service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:28.918098 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-1ffac12e-f84d-4eed-834a-c05b7c3fd42b req-7303e2eb-94b3-4616-ac88-531ffcf37dbf service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:28.931978 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-1ffac12e-f84d-4eed-834a-c05b7c3fd42b req-7303e2eb-94b3-4616-ac88-531ffcf37dbf service nova] Creating event network-changed:115b315e-aa00-4ff6-9273-ebeabdd14b26 for instance fab8f2eb-71c8-4956-b693-06f73bf86964 on hv-cinder-79760 Jun 17 08:56:28.935610 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-1ffac12e-f84d-4eed-834a-c05b7c3fd42b req-7303e2eb-94b3-4616-ac88-531ffcf37dbf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030983 Jun 17 08:56:28.936547 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 341/688] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:56:29.228782 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-532d4f39-e267-4383-9c29-404d558d1ecb tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:29.229418 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-532d4f39-e267-4383-9c29-404d558d1ecb tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:29.236917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-532d4f39-e267-4383-9c29-404d558d1ecb tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:29.237464 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-532d4f39-e267-4383-9c29-404d558d1ecb tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:29.238381 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-532d4f39-e267-4383-9c29-404d558d1ecb tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:29.238888 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-532d4f39-e267-4383-9c29-404d558d1ecb tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:29.264076 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-b721104f-9eff-48b6-9904-ee725a33820a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:29.264666 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-b721104f-9eff-48b6-9904-ee725a33820a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:29.272958 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b721104f-9eff-48b6-9904-ee725a33820a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:29.273732 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b721104f-9eff-48b6-9904-ee725a33820a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:29.274601 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b721104f-9eff-48b6-9904-ee725a33820a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:29.275034 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b721104f-9eff-48b6-9904-ee725a33820a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:29.310005 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-b721104f-9eff-48b6-9904-ee725a33820a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976/os-volume_attachments/1cbf37b8-ac90-40d2-b7f7-d6deccb2a363" status: 200 len: 194 microversion: 2.20 time: 0.051417 Jun 17 08:56:29.310915 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 342/689] 10.222.0.78 () {60 vars in 1453 bytes} [Fri Jun 17 08:56:29 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976/os-volume_attachments/1cbf37b8-ac90-40d2-b7f7-d6deccb2a363 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 08:56:29.324669 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-f7a8f5b8-1482-4047-b6ab-f7785476d0f8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:29.324941 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-f7a8f5b8-1482-4047-b6ab-f7785476d0f8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:29.338678 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f7a8f5b8-1482-4047-b6ab-f7785476d0f8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:29.339268 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f7a8f5b8-1482-4047-b6ab-f7785476d0f8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:29.340309 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f7a8f5b8-1482-4047-b6ab-f7785476d0f8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:29.340858 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f7a8f5b8-1482-4047-b6ab-f7785476d0f8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:29.429903 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-532d4f39-e267-4383-9c29-404d558d1ecb tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:29.439945 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-532d4f39-e267-4383-9c29-404d558d1ecb tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1757 microversion: 2.1 time: 0.214897 Jun 17 08:56:29.441264 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 348/690] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:29 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1757 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:29.454697 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-025f91ae-dc57-48a9-8a29-fd552ba86e80 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:29.455363 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-025f91ae-dc57-48a9-8a29-fd552ba86e80 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:29.462687 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-025f91ae-dc57-48a9-8a29-fd552ba86e80 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:29.463168 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-025f91ae-dc57-48a9-8a29-fd552ba86e80 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:29.463982 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-025f91ae-dc57-48a9-8a29-fd552ba86e80 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:29.464419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-025f91ae-dc57-48a9-8a29-fd552ba86e80 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:29.510475 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f7a8f5b8-1482-4047-b6ab-f7785476d0f8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:29.518955 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-f7a8f5b8-1482-4047-b6ab-f7785476d0f8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964" status: 200 len: 1366 microversion: 2.1 time: 0.198245 Jun 17 08:56:29.520534 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 343/691] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:29 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:56:29.591846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.objects.instance [None req-025f91ae-dc57-48a9-8a29-fd552ba86e80 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lazy-loading 'services' on Instance uuid 397d996b-b163-4a47-856e-f2aca2ae6976 {{(pid=129876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:56:29.870052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-025f91ae-dc57-48a9-8a29-fd552ba86e80 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "DELETE /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976/os-volume_attachments/1cbf37b8-ac90-40d2-b7f7-d6deccb2a363" status: 202 len: 0 microversion: 2.20 time: 0.426791 Jun 17 08:56:29.870654 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 349/692] 10.222.0.78 () {60 vars in 1456 bytes} [Fri Jun 17 08:56:29 2022] DELETE /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976/os-volume_attachments/1cbf37b8-ac90-40d2-b7f7-d6deccb2a363 => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:56:29.878948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-dd7f25e8-f90d-414e-afd7-cc030bc5b067 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:29.880071 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-dd7f25e8-f90d-414e-afd7-cc030bc5b067 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:29.886291 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-dd7f25e8-f90d-414e-afd7-cc030bc5b067 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:29.887340 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-dd7f25e8-f90d-414e-afd7-cc030bc5b067 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:29.887340 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-dd7f25e8-f90d-414e-afd7-cc030bc5b067 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:29.887340 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-dd7f25e8-f90d-414e-afd7-cc030bc5b067 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:29.906596 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:29.920568 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-dd7f25e8-f90d-414e-afd7-cc030bc5b067 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045578 Jun 17 08:56:29.921126 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 344/693] 10.222.0.78 () {60 vars in 1342 bytes} [Fri Jun 17 08:56:29 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:56:30.459612 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a458dabe-19b1-4116-bba2-f00e1e297c64 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:30.460318 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a458dabe-19b1-4116-bba2-f00e1e297c64 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:30.467208 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a458dabe-19b1-4116-bba2-f00e1e297c64 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:30.467858 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a458dabe-19b1-4116-bba2-f00e1e297c64 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:30.468444 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a458dabe-19b1-4116-bba2-f00e1e297c64 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:30.468885 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a458dabe-19b1-4116-bba2-f00e1e297c64 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:30.538237 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-429071d1-3a86-492a-a3f2-76046387ba3e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:30.538920 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-429071d1-3a86-492a-a3f2-76046387ba3e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:30.546630 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-429071d1-3a86-492a-a3f2-76046387ba3e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:30.547086 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-429071d1-3a86-492a-a3f2-76046387ba3e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:30.548266 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-429071d1-3a86-492a-a3f2-76046387ba3e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:30.548398 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-429071d1-3a86-492a-a3f2-76046387ba3e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:30.654307 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a458dabe-19b1-4116-bba2-f00e1e297c64 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:30.663531 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a458dabe-19b1-4116-bba2-f00e1e297c64 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1757 microversion: 2.1 time: 0.209089 Jun 17 08:56:30.664117 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 350/694] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:30 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1757 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:30.719480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-429071d1-3a86-492a-a3f2-76046387ba3e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:30.730529 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-429071d1-3a86-492a-a3f2-76046387ba3e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964" status: 200 len: 1366 microversion: 2.1 time: 0.196873 Jun 17 08:56:30.731754 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 345/695] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:30 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:56:30.933855 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-3ae32ae4-c381-45b5-9ea3-bce37787d365 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:30.934866 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-3ae32ae4-c381-45b5-9ea3-bce37787d365 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:30.941368 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3ae32ae4-c381-45b5-9ea3-bce37787d365 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:30.941837 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3ae32ae4-c381-45b5-9ea3-bce37787d365 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:30.942697 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3ae32ae4-c381-45b5-9ea3-bce37787d365 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:30.943142 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3ae32ae4-c381-45b5-9ea3-bce37787d365 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:30.975996 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-3ae32ae4-c381-45b5-9ea3-bce37787d365 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046322 Jun 17 08:56:30.976508 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 351/696] 10.222.0.78 () {60 vars in 1342 bytes} [Fri Jun 17 08:56:30 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:56:31.685996 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1a56d646-58aa-4b86-96ca-81d75817ee12 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:31.685996 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-1a56d646-58aa-4b86-96ca-81d75817ee12 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:31.689608 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1a56d646-58aa-4b86-96ca-81d75817ee12 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:31.690127 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1a56d646-58aa-4b86-96ca-81d75817ee12 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:31.690969 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1a56d646-58aa-4b86-96ca-81d75817ee12 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:31.691989 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1a56d646-58aa-4b86-96ca-81d75817ee12 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:31.752338 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-9cf9021c-f8b6-4ee0-867b-62cb86d0d85e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:31.753573 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-9cf9021c-f8b6-4ee0-867b-62cb86d0d85e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:31.763120 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9cf9021c-f8b6-4ee0-867b-62cb86d0d85e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:31.763832 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9cf9021c-f8b6-4ee0-867b-62cb86d0d85e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:31.764667 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9cf9021c-f8b6-4ee0-867b-62cb86d0d85e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:31.765274 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9cf9021c-f8b6-4ee0-867b-62cb86d0d85e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:31.949709 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-1a56d646-58aa-4b86-96ca-81d75817ee12 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:31.964074 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-1a56d646-58aa-4b86-96ca-81d75817ee12 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1757 microversion: 2.1 time: 0.287182 Jun 17 08:56:31.971321 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 346/697] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:31 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1757 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:31.988888 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-287b8d50-a398-44ae-8550-01fcd0c15fd8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:31.990260 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-9cf9021c-f8b6-4ee0-867b-62cb86d0d85e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:31.991101 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-287b8d50-a398-44ae-8550-01fcd0c15fd8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:31.997544 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-287b8d50-a398-44ae-8550-01fcd0c15fd8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:31.998001 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-287b8d50-a398-44ae-8550-01fcd0c15fd8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:31.998285 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-9cf9021c-f8b6-4ee0-867b-62cb86d0d85e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964" status: 200 len: 1366 microversion: 2.1 time: 0.250627 Jun 17 08:56:31.998811 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-287b8d50-a398-44ae-8550-01fcd0c15fd8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:31.998914 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 352/698] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:31 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:31.999226 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-287b8d50-a398-44ae-8550-01fcd0c15fd8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:32.032171 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-287b8d50-a398-44ae-8550-01fcd0c15fd8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048155 Jun 17 08:56:32.032764 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 347/699] 10.222.0.78 () {60 vars in 1342 bytes} [Fri Jun 17 08:56:31 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:56:32.989670 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-be602abc-786b-4f99-8994-373f66dc365b tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:32.990360 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-be602abc-786b-4f99-8994-373f66dc365b tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:32.997848 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-be602abc-786b-4f99-8994-373f66dc365b tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:32.998354 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-be602abc-786b-4f99-8994-373f66dc365b tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:32.999143 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-be602abc-786b-4f99-8994-373f66dc365b tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:32.999610 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-be602abc-786b-4f99-8994-373f66dc365b tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:33.017044 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a8bda108-287d-4e74-9e07-2ee708e34e7a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:33.017662 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-a8bda108-287d-4e74-9e07-2ee708e34e7a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:33.025729 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a8bda108-287d-4e74-9e07-2ee708e34e7a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:33.026226 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a8bda108-287d-4e74-9e07-2ee708e34e7a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:33.027084 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a8bda108-287d-4e74-9e07-2ee708e34e7a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:33.027755 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a8bda108-287d-4e74-9e07-2ee708e34e7a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:33.227206 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a8bda108-287d-4e74-9e07-2ee708e34e7a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:33.232067 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-be602abc-786b-4f99-8994-373f66dc365b tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:33.234869 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-a8bda108-287d-4e74-9e07-2ee708e34e7a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964" status: 200 len: 1366 microversion: 2.1 time: 0.221747 Jun 17 08:56:33.240637 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 348/700] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:33 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:56:33.240637 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-47744ebc-8e25-401f-b956-717cffa02d25 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:33.241070 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-be602abc-786b-4f99-8994-373f66dc365b tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1757 microversion: 2.1 time: 0.255726 Jun 17 08:56:33.241572 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-47744ebc-8e25-401f-b956-717cffa02d25 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:33.242287 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 353/701] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:32 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1757 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:33.247924 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-47744ebc-8e25-401f-b956-717cffa02d25 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:33.248808 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-47744ebc-8e25-401f-b956-717cffa02d25 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:33.249298 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-47744ebc-8e25-401f-b956-717cffa02d25 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:33.249794 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-47744ebc-8e25-401f-b956-717cffa02d25 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:33.279665 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-47744ebc-8e25-401f-b956-717cffa02d25 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043079 Jun 17 08:56:33.280284 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 349/702] 10.222.0.78 () {60 vars in 1342 bytes} [Fri Jun 17 08:56:33 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:33.340114 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-ee742ee6-9344-47a2-8d1a-cf1927d8be00 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:33.340604 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-ee742ee6-9344-47a2-8d1a-cf1927d8be00 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:33.346581 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ee742ee6-9344-47a2-8d1a-cf1927d8be00 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:33.347026 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ee742ee6-9344-47a2-8d1a-cf1927d8be00 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:33.347891 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ee742ee6-9344-47a2-8d1a-cf1927d8be00 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:33.348344 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ee742ee6-9344-47a2-8d1a-cf1927d8be00 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:33.374768 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-ee742ee6-9344-47a2-8d1a-cf1927d8be00 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Going to try to terminate instance {{(pid=129876) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:56:33.411653 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:33.745506 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-ee742ee6-9344-47a2-8d1a-cf1927d8be00 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "DELETE /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 204 len: 0 microversion: 2.20 time: 0.408743 Jun 17 08:56:33.746226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 354/703] 10.222.0.78 () {60 vars in 1279 bytes} [Fri Jun 17 08:56:33 2022] DELETE /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 08:56:33.760297 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-636fa325-bbbc-4e80-8df2-e37f196f8fa8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:33.760297 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-636fa325-bbbc-4e80-8df2-e37f196f8fa8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:33.763692 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-636fa325-bbbc-4e80-8df2-e37f196f8fa8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:33.764324 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-636fa325-bbbc-4e80-8df2-e37f196f8fa8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:33.765095 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-636fa325-bbbc-4e80-8df2-e37f196f8fa8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:33.765635 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-636fa325-bbbc-4e80-8df2-e37f196f8fa8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:34.138515 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-636fa325-bbbc-4e80-8df2-e37f196f8fa8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:34.147597 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-636fa325-bbbc-4e80-8df2-e37f196f8fa8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:34.149110 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-636fa325-bbbc-4e80-8df2-e37f196f8fa8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:34.150297 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-636fa325-bbbc-4e80-8df2-e37f196f8fa8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1724 microversion: 2.20 time: 0.399238 Jun 17 08:56:34.150856 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 350/704] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:56:33 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1724 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:56:34.260285 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-16f8cbd1-f7a0-41fb-8a64-2ee7116d943f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:34.261008 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-16f8cbd1-f7a0-41fb-8a64-2ee7116d943f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:34.261487 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d1088f8e-75a7-40b4-ac40-6b754190ad79 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:34.262197 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-d1088f8e-75a7-40b4-ac40-6b754190ad79 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:34.268551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d1088f8e-75a7-40b4-ac40-6b754190ad79 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:34.268729 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-16f8cbd1-f7a0-41fb-8a64-2ee7116d943f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:34.268996 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d1088f8e-75a7-40b4-ac40-6b754190ad79 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:34.269110 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-16f8cbd1-f7a0-41fb-8a64-2ee7116d943f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:34.270298 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d1088f8e-75a7-40b4-ac40-6b754190ad79 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:34.270454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-16f8cbd1-f7a0-41fb-8a64-2ee7116d943f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:34.270726 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d1088f8e-75a7-40b4-ac40-6b754190ad79 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:34.270858 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-16f8cbd1-f7a0-41fb-8a64-2ee7116d943f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:34.463435 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d1088f8e-75a7-40b4-ac40-6b754190ad79 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:34.470817 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-d1088f8e-75a7-40b4-ac40-6b754190ad79 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964" status: 200 len: 1366 microversion: 2.1 time: 0.213382 Jun 17 08:56:34.471405 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 351/705] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:34 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:56:34.485509 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-16f8cbd1-f7a0-41fb-8a64-2ee7116d943f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:34.494738 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-16f8cbd1-f7a0-41fb-8a64-2ee7116d943f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1757 microversion: 2.1 time: 0.239542 Jun 17 08:56:34.495338 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 355/706] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:34 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1757 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:35.179815 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-ab781cfb-6ad7-469d-9167-4b84eba4d8f1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:35.179815 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-ab781cfb-6ad7-469d-9167-4b84eba4d8f1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:35.179815 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=2 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:35.179815 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=6 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:35.179815 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ab781cfb-6ad7-469d-9167-4b84eba4d8f1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:35.180824 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ab781cfb-6ad7-469d-9167-4b84eba4d8f1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:35.180824 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ab781cfb-6ad7-469d-9167-4b84eba4d8f1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:35.180824 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ab781cfb-6ad7-469d-9167-4b84eba4d8f1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:35.311436 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-ab781cfb-6ad7-469d-9167-4b84eba4d8f1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:35.319942 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-ab781cfb-6ad7-469d-9167-4b84eba4d8f1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:35.321423 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-ab781cfb-6ad7-469d-9167-4b84eba4d8f1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:35.322567 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-ab781cfb-6ad7-469d-9167-4b84eba4d8f1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1724 microversion: 2.20 time: 0.156899 Jun 17 08:56:35.323131 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 352/707] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:56:35 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:56:35.485775 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=6 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:35.491226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-150d92b4-bcda-4075-aad4-016012dd7127 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:35.492279 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-150d92b4-bcda-4075-aad4-016012dd7127 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:35.500192 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-150d92b4-bcda-4075-aad4-016012dd7127 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:35.500712 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-150d92b4-bcda-4075-aad4-016012dd7127 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:35.501530 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-150d92b4-bcda-4075-aad4-016012dd7127 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:35.501976 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-150d92b4-bcda-4075-aad4-016012dd7127 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:35.515864 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-eea0ab62-1a2b-42ec-bda8-0d27443da6f4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:35.516763 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-eea0ab62-1a2b-42ec-bda8-0d27443da6f4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:35.539620 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eea0ab62-1a2b-42ec-bda8-0d27443da6f4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:35.540088 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eea0ab62-1a2b-42ec-bda8-0d27443da6f4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:35.540963 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eea0ab62-1a2b-42ec-bda8-0d27443da6f4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:35.541411 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eea0ab62-1a2b-42ec-bda8-0d27443da6f4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:35.770458 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-150d92b4-bcda-4075-aad4-016012dd7127 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:35.778670 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-150d92b4-bcda-4075-aad4-016012dd7127 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964" status: 200 len: 1366 microversion: 2.1 time: 0.293801 Jun 17 08:56:35.779395 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 356/708] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:35 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 => generated 1366 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:35.795301 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-fcf14169-65f1-49f8-81db-6243d0ed3b94 req-484ec197-7fef-494b-b02d-caf41db42ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab8f2eb-71c8-4956-b693-06f73bf86964", "name": "network-vif-plugged", "status": "completed", "tag": "115b315e-aa00-4ff6-9273-ebeabdd14b26"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:56:35.798454 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-eea0ab62-1a2b-42ec-bda8-0d27443da6f4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:35.804696 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-fcf14169-65f1-49f8-81db-6243d0ed3b94 req-484ec197-7fef-494b-b02d-caf41db42ed8 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:35.807863 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-fcf14169-65f1-49f8-81db-6243d0ed3b94 req-484ec197-7fef-494b-b02d-caf41db42ed8 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:35.808303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-eea0ab62-1a2b-42ec-bda8-0d27443da6f4 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1757 microversion: 2.1 time: 0.298213 Jun 17 08:56:35.808303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 353/709] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:35 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1757 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:35.829033 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-fcf14169-65f1-49f8-81db-6243d0ed3b94 req-484ec197-7fef-494b-b02d-caf41db42ed8 service nova] Creating event network-vif-plugged:115b315e-aa00-4ff6-9273-ebeabdd14b26 for instance fab8f2eb-71c8-4956-b693-06f73bf86964 on hv-cinder-79760 Jun 17 08:56:35.835743 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-fcf14169-65f1-49f8-81db-6243d0ed3b94 req-484ec197-7fef-494b-b02d-caf41db42ed8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044433 Jun 17 08:56:35.842021 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 357/710] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:56:36.342853 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-b63da180-1152-4b7a-8a03-9a62b030ec6a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:36.344813 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-b63da180-1152-4b7a-8a03-9a62b030ec6a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:36.355505 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b63da180-1152-4b7a-8a03-9a62b030ec6a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:36.355505 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b63da180-1152-4b7a-8a03-9a62b030ec6a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:36.355505 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b63da180-1152-4b7a-8a03-9a62b030ec6a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:36.355505 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b63da180-1152-4b7a-8a03-9a62b030ec6a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:36.440463 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b63da180-1152-4b7a-8a03-9a62b030ec6a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:36.451031 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b63da180-1152-4b7a-8a03-9a62b030ec6a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:36.451950 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b63da180-1152-4b7a-8a03-9a62b030ec6a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:36.453056 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-b63da180-1152-4b7a-8a03-9a62b030ec6a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1657 microversion: 2.20 time: 0.115193 Jun 17 08:56:36.464464 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 354/711] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:56:36 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1657 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:56:36.512900 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-4139dd28-af71-40c8-8b03-74d9b29df469 req-6167e6b5-0ac1-46d4-80bb-c54bce2df5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397d996b-b163-4a47-856e-f2aca2ae6976", "name": "network-vif-deleted", "tag": "051f4b45-cbb1-44c1-92a3-54becef75c28"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:56:36.522819 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-4139dd28-af71-40c8-8b03-74d9b29df469 req-6167e6b5-0ac1-46d4-80bb-c54bce2df5d5 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:36.523287 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-4139dd28-af71-40c8-8b03-74d9b29df469 req-6167e6b5-0ac1-46d4-80bb-c54bce2df5d5 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:36.536465 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-4139dd28-af71-40c8-8b03-74d9b29df469 req-6167e6b5-0ac1-46d4-80bb-c54bce2df5d5 service nova] Creating event network-vif-deleted:051f4b45-cbb1-44c1-92a3-54becef75c28 for instance 397d996b-b163-4a47-856e-f2aca2ae6976 on hv-cinder-79760 Jun 17 08:56:36.542108 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-4139dd28-af71-40c8-8b03-74d9b29df469 req-6167e6b5-0ac1-46d4-80bb-c54bce2df5d5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033236 Jun 17 08:56:36.542894 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 358/712] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:56:36.797061 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-2a248683-bf98-4b8a-b7a2-361e74f54382 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:36.797601 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-2a248683-bf98-4b8a-b7a2-361e74f54382 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:36.804505 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2a248683-bf98-4b8a-b7a2-361e74f54382 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:36.804953 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2a248683-bf98-4b8a-b7a2-361e74f54382 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:36.805737 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2a248683-bf98-4b8a-b7a2-361e74f54382 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:36.806179 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2a248683-bf98-4b8a-b7a2-361e74f54382 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:36.824882 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-88ab792c-c929-496d-be44-0076d99c2bd8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:36.825682 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-88ab792c-c929-496d-be44-0076d99c2bd8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:36.833306 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-88ab792c-c929-496d-be44-0076d99c2bd8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:36.834398 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-88ab792c-c929-496d-be44-0076d99c2bd8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:36.838187 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-88ab792c-c929-496d-be44-0076d99c2bd8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:36.838187 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-88ab792c-c929-496d-be44-0076d99c2bd8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:37.011097 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2a248683-bf98-4b8a-b7a2-361e74f54382 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:37.020382 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-2a248683-bf98-4b8a-b7a2-361e74f54382 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964" status: 200 len: 1366 microversion: 2.1 time: 0.226496 Jun 17 08:56:37.020978 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 355/713] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:36 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:37.045035 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-88ab792c-c929-496d-be44-0076d99c2bd8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:37.053963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-88ab792c-c929-496d-be44-0076d99c2bd8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1760 microversion: 2.1 time: 0.233493 Jun 17 08:56:37.054651 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 359/714] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:36 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1760 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:37.472110 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d63cd5ba-7d1a-4540-a67c-495f4a20e877 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:37.472873 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-d63cd5ba-7d1a-4540-a67c-495f4a20e877 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:37.479952 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d63cd5ba-7d1a-4540-a67c-495f4a20e877 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:37.480411 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d63cd5ba-7d1a-4540-a67c-495f4a20e877 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:37.481199 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d63cd5ba-7d1a-4540-a67c-495f4a20e877 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:37.481639 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d63cd5ba-7d1a-4540-a67c-495f4a20e877 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:37.548966 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d63cd5ba-7d1a-4540-a67c-495f4a20e877 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:37.557408 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d63cd5ba-7d1a-4540-a67c-495f4a20e877 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:37.559095 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d63cd5ba-7d1a-4540-a67c-495f4a20e877 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:37.560300 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-d63cd5ba-7d1a-4540-a67c-495f4a20e877 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1657 microversion: 2.20 time: 0.092152 Jun 17 08:56:37.560881 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 356/715] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:56:37 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1657 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:56:38.037610 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-65ce87cc-8367-4896-a122-bfdc31810263 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:38.038369 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-65ce87cc-8367-4896-a122-bfdc31810263 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:38.044968 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-65ce87cc-8367-4896-a122-bfdc31810263 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:38.045430 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-65ce87cc-8367-4896-a122-bfdc31810263 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:38.046204 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-65ce87cc-8367-4896-a122-bfdc31810263 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:38.046650 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-65ce87cc-8367-4896-a122-bfdc31810263 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:38.178054 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-65ce87cc-8367-4896-a122-bfdc31810263 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:38.185900 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-65ce87cc-8367-4896-a122-bfdc31810263 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964" status: 200 len: 1366 microversion: 2.1 time: 0.152113 Jun 17 08:56:38.186474 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 360/716] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:38 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:38.579041 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-c9b799f9-e02f-4439-b159-7dad2f9e2a3a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:38.579756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-c9b799f9-e02f-4439-b159-7dad2f9e2a3a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:38.586469 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c9b799f9-e02f-4439-b159-7dad2f9e2a3a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:38.586918 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c9b799f9-e02f-4439-b159-7dad2f9e2a3a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:38.587709 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c9b799f9-e02f-4439-b159-7dad2f9e2a3a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:38.588251 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c9b799f9-e02f-4439-b159-7dad2f9e2a3a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:38.652013 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c9b799f9-e02f-4439-b159-7dad2f9e2a3a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:38.659961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c9b799f9-e02f-4439-b159-7dad2f9e2a3a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:38.661452 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c9b799f9-e02f-4439-b159-7dad2f9e2a3a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:38.662635 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-c9b799f9-e02f-4439-b159-7dad2f9e2a3a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1657 microversion: 2.20 time: 0.087450 Jun 17 08:56:38.663190 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 357/717] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:56:38 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1657 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:56:39.203307 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a79ef105-7025-42ac-81c6-058c4ab7c71a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:39.208550 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a79ef105-7025-42ac-81c6-058c4ab7c71a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:39.210437 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a79ef105-7025-42ac-81c6-058c4ab7c71a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:39.210891 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a79ef105-7025-42ac-81c6-058c4ab7c71a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:39.211750 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a79ef105-7025-42ac-81c6-058c4ab7c71a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:39.212192 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a79ef105-7025-42ac-81c6-058c4ab7c71a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:39.348919 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a79ef105-7025-42ac-81c6-058c4ab7c71a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:39.357302 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a79ef105-7025-42ac-81c6-058c4ab7c71a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964" status: 200 len: 1366 microversion: 2.1 time: 0.157849 Jun 17 08:56:39.357903 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 361/718] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:39 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:39.681521 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-421fb58a-c04e-49a6-a63c-4f0c9aba9f8e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:39.682134 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-421fb58a-c04e-49a6-a63c-4f0c9aba9f8e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:39.689397 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-421fb58a-c04e-49a6-a63c-4f0c9aba9f8e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:39.689819 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-421fb58a-c04e-49a6-a63c-4f0c9aba9f8e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:39.690595 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-421fb58a-c04e-49a6-a63c-4f0c9aba9f8e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:39.691036 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-421fb58a-c04e-49a6-a63c-4f0c9aba9f8e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:39.726861 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-421fb58a-c04e-49a6-a63c-4f0c9aba9f8e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:39.727220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-421fb58a-c04e-49a6-a63c-4f0c9aba9f8e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:39.727710 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-421fb58a-c04e-49a6-a63c-4f0c9aba9f8e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lazy-loading 'fault' on Instance uuid 397d996b-b163-4a47-856e-f2aca2ae6976 {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:56:39.770828 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-421fb58a-c04e-49a6-a63c-4f0c9aba9f8e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:39.779341 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-421fb58a-c04e-49a6-a63c-4f0c9aba9f8e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:39.780872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-421fb58a-c04e-49a6-a63c-4f0c9aba9f8e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:39.782040 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-421fb58a-c04e-49a6-a63c-4f0c9aba9f8e tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1371 microversion: 2.20 time: 0.104542 Jun 17 08:56:39.782610 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 358/719] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:56:39 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:56:40.374191 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-0ba26311-17b1-452d-9b93-1a04f395741c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:40.374862 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-0ba26311-17b1-452d-9b93-1a04f395741c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:40.382699 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0ba26311-17b1-452d-9b93-1a04f395741c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:40.383152 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0ba26311-17b1-452d-9b93-1a04f395741c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:40.383998 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0ba26311-17b1-452d-9b93-1a04f395741c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:40.384435 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0ba26311-17b1-452d-9b93-1a04f395741c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:40.523333 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-0ba26311-17b1-452d-9b93-1a04f395741c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:40.531105 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-0ba26311-17b1-452d-9b93-1a04f395741c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964" status: 200 len: 1366 microversion: 2.1 time: 0.160743 Jun 17 08:56:40.531610 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 362/720] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:40 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:40.799891 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-5600a9d7-bc77-43d4-9df7-5879899a710c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:40.800500 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-5600a9d7-bc77-43d4-9df7-5879899a710c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:40.807050 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5600a9d7-bc77-43d4-9df7-5879899a710c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:40.807805 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5600a9d7-bc77-43d4-9df7-5879899a710c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:40.808572 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5600a9d7-bc77-43d4-9df7-5879899a710c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:40.809094 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5600a9d7-bc77-43d4-9df7-5879899a710c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:40.844430 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5600a9d7-bc77-43d4-9df7-5879899a710c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:40.844880 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5600a9d7-bc77-43d4-9df7-5879899a710c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:40.845339 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-5600a9d7-bc77-43d4-9df7-5879899a710c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lazy-loading 'fault' on Instance uuid 397d996b-b163-4a47-856e-f2aca2ae6976 {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:56:40.886476 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-5600a9d7-bc77-43d4-9df7-5879899a710c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:40.895493 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-5600a9d7-bc77-43d4-9df7-5879899a710c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:40.897068 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-5600a9d7-bc77-43d4-9df7-5879899a710c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:40.898253 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-5600a9d7-bc77-43d4-9df7-5879899a710c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 200 len: 1371 microversion: 2.20 time: 0.102266 Jun 17 08:56:40.898823 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 359/721] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:56:40 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:56:41.548961 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-0fbb5c11-eeeb-4834-a8bb-dbfb7278eb9a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:41.549602 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-0fbb5c11-eeeb-4834-a8bb-dbfb7278eb9a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:41.556778 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0fbb5c11-eeeb-4834-a8bb-dbfb7278eb9a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:41.557226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0fbb5c11-eeeb-4834-a8bb-dbfb7278eb9a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:41.558235 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0fbb5c11-eeeb-4834-a8bb-dbfb7278eb9a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:41.558665 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0fbb5c11-eeeb-4834-a8bb-dbfb7278eb9a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:41.688670 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-0fbb5c11-eeeb-4834-a8bb-dbfb7278eb9a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:41.696952 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-0fbb5c11-eeeb-4834-a8bb-dbfb7278eb9a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964" status: 200 len: 1555 microversion: 2.1 time: 0.151822 Jun 17 08:56:41.697526 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 363/722] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:41 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:41.713107 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0d0e3970-71b0-4357-8f31-c6cc4af21b5a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:41.713526 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0d0e3970-71b0-4357-8f31-c6cc4af21b5a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:41.719908 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0d0e3970-71b0-4357-8f31-c6cc4af21b5a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:41.720355 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0d0e3970-71b0-4357-8f31-c6cc4af21b5a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:41.721106 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0d0e3970-71b0-4357-8f31-c6cc4af21b5a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:41.721534 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0d0e3970-71b0-4357-8f31-c6cc4af21b5a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:41.738959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=100 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:41.803648 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0d0e3970-71b0-4357-8f31-c6cc4af21b5a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094451 Jun 17 08:56:41.804272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 360/723] 10.222.0.78 () {58 vars in 1274 bytes} [Fri Jun 17 08:56:41 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:56:41.917162 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-18882f66-6835-4fea-9633-eb04bb3dbb0b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:41.917884 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-18882f66-6835-4fea-9633-eb04bb3dbb0b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:41.924065 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-18882f66-6835-4fea-9633-eb04bb3dbb0b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:41.924504 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-18882f66-6835-4fea-9633-eb04bb3dbb0b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:41.925311 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-18882f66-6835-4fea-9633-eb04bb3dbb0b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:41.926334 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-18882f66-6835-4fea-9633-eb04bb3dbb0b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:41.940930 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-18882f66-6835-4fea-9633-eb04bb3dbb0b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] HTTP exception thrown: Instance 397d996b-b163-4a47-856e-f2aca2ae6976 could not be found. Jun 17 08:56:41.942625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-18882f66-6835-4fea-9633-eb04bb3dbb0b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Request method failure captured: Jun 17 08:56:41.942625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 HTTP/1.1 Jun 17 08:56:41.942625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:56:41.942625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:56:41.942625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:56:41.942625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 08:56:41.942625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:56:41.942625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:56:41.942625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:56:41.942625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:56:41.942625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirECpO4HU2x-T5tTPcpP_G91Ta42vbNddPWYj9UNOGh7dCt7rCs7Pv61pFmj2vJdKVpqOk2RI8b4DPp9aauMdSVkosSGW7qQUabZMh2mwq7th2LcTqx_JDY72sQeakoMZNPX0YEvJmTwi5Zi8i6sBKL2AhN8jsUF9RFfXgg1PSB-5Y8Q Jun 17 08:56:41.942625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:56:41.942625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:56:41.942625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:56:41.942625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:56:41.942625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 08:56:41.942625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:56:41.942625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:56:41.942625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: b493dbf75ed64a7dbda3e9c6a6168f8f Jun 17 08:56:41.942625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1501423591 Jun 17 08:56:41.942625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:56:41.942625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:56:41.944348 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b493dbf75ed64a7dbda3e9c6a6168f8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b493dbf75ed64a7dbda3e9c6a6168f8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b493dbf75ed64a7dbda3e9c6a6168f8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b493dbf75ed64a7dbda3e9c6a6168f8f"}]}] Jun 17 08:56:41.944348 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1501423591 Jun 17 08:56:41.944348 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: b493dbf75ed64a7dbda3e9c6a6168f8f Jun 17 08:56:41.944348 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1501423591 Jun 17 08:56:41.944348 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-AttachVolumeShelveTestJSON-1501423591-project Jun 17 08:56:41.944348 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:56:41.944348 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:56:41.944348 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: b0eb46b0aeeb46fe8dcdb02f29ae4013 Jun 17 08:56:41.944348 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1501423591-project Jun 17 08:56:41.944348 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 08:56:41.944348 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Instance 397d996b-b163-4a47-856e-f2aca2ae6976 could not be found. Jun 17 08:56:41.944348 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'id': '397d996b-b163-4a47-856e-f2aca2ae6976'} Jun 17 08:56:41.945233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:56:41.945233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:56:41.945233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:56:41.945233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:56:41.945233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:56:41.945233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:56:41.945233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:56:41.945233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:56:41.945233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:56:41.945233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:56:41.945233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 397d996b-b163-4a47-856e-f2aca2ae6976 could not be found. Jun 17 08:56:41.945233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:56:41.945233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:56:41.945233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:56:41.945233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:56:41.945233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:56:41.945233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:56:41.945233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:56:41.945233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:56:41.945233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:56:41.946495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:56:41.946495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:56:41.946495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:56:41.946495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:56:41.946495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:56:41.946495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:56:41.946495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:56:41.946495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 397d996b-b163-4a47-856e-f2aca2ae6976 could not be found. Jun 17 08:56:41.946495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:56:41.946495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:56:41.946495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:56:41.946495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:56:41.946495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:56:41.946495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:56:41.946495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:56:41.946495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:56:41.946495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 397d996b-b163-4a47-856e-f2aca2ae6976 could not be found. Jun 17 08:56:41.946495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:56:41.947673 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-18882f66-6835-4fea-9633-eb04bb3dbb0b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Returning 404 to user: Instance 397d996b-b163-4a47-856e-f2aca2ae6976 could not be found. {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:56:41.947673 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-18882f66-6835-4fea-9633-eb04bb3dbb0b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 404 len: 111 microversion: 2.20 time: 0.030986 Jun 17 08:56:41.947673 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 364/724] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:56:41 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 08:56:41.954481 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1d27c53a-1a82-448e-b4a8-eb48f9ef3424 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '.version_select at 0x7fbc401f9940>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:42.056605 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-1d27c53a-1a82-448e-b4a8-eb48f9ef3424 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-218135140" status: 204 len: 0 microversion: 2.20 time: 0.106529 Jun 17 08:56:42.057716 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 361/725] 10.222.0.78 () {60 vars in 1258 bytes} [Fri Jun 17 08:56:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-218135140 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 08:56:42.893625 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-5f5dd30f-0255-410b-9cfc-f5167da2d605 req-074de1b6-0d23-4d1d-b832-8177f54172a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fab8f2eb-71c8-4956-b693-06f73bf86964", "tag": "115b315e-aa00-4ff6-9273-ebeabdd14b26"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:56:42.903719 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-5f5dd30f-0255-410b-9cfc-f5167da2d605 req-074de1b6-0d23-4d1d-b832-8177f54172a0 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:42.904449 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-5f5dd30f-0255-410b-9cfc-f5167da2d605 req-074de1b6-0d23-4d1d-b832-8177f54172a0 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:42.918588 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-5f5dd30f-0255-410b-9cfc-f5167da2d605 req-074de1b6-0d23-4d1d-b832-8177f54172a0 service nova] Creating event network-changed:115b315e-aa00-4ff6-9273-ebeabdd14b26 for instance fab8f2eb-71c8-4956-b693-06f73bf86964 on hv-cinder-79760 Jun 17 08:56:42.919919 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-451a3177-0ae3-49a5-8dd3-a5b9808b9fdd tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Action: 'create', calling method: .version_select at 0x7fbc4015f040>, body: {"keypair": {"name": "tempest-keypair-1282411073", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjl3R5so3w/ZDzRkdkzVWXp6TNRYro/1gWjhDIeDQxOxYYXCUTWMXQkQ1j55WOUViOxm7l94mRTuPNZcGd5TUryI9y9fGuEoQ8lCphDBU+oygENxZSWmkaVWkxwJZ2I9w=="}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:56:42.924682 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-5f5dd30f-0255-410b-9cfc-f5167da2d605 req-074de1b6-0d23-4d1d-b832-8177f54172a0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035480 Jun 17 08:56:42.925406 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 365/726] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:56:42.937105 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-451a3177-0ae3-49a5-8dd3-a5b9808b9fdd tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Getting quotas for project b493dbf75ed64a7dbda3e9c6a6168f8f. Resources: {'key_pairs'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:56:42.941766 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-451a3177-0ae3-49a5-8dd3-a5b9808b9fdd tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Getting quotas for user b0eb46b0aeeb46fe8dcdb02f29ae4013 and project b493dbf75ed64a7dbda3e9c6a6168f8f. Resources: {'key_pairs'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:56:43.032669 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-451a3177-0ae3-49a5-8dd3-a5b9808b9fdd tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.117214 Jun 17 08:56:43.033434 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 362/727] 10.222.0.78 () {62 vars in 1199 bytes} [Fri Jun 17 08:56:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 119 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 17 08:56:45.783558 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-b70903bf-4428-4f55-95d4-d2a77294305a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-491441093", "imageRef": "978084c7-ed2c-4e42-ac8b-f5d19c4001fe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4f7d1d4a-2c54-4698-9b36-243535e9ccac"}], "security_groups": [{"name": "tempest-securitygroup--196858510"}], "key_name": "tempest-keypair-1282411073", "user_data": "}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:56:46.052330 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.network.neutron [None req-b70903bf-4428-4f55-95d4-d2a77294305a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] validate_networks() for [('4f7d1d4a-2c54-4698-9b36-243535e9ccac', None, None, None, None, None)] {{(pid=129876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:56:46.431570 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-b70903bf-4428-4f55-95d4-d2a77294305a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Flavor limits 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:56:46.432005 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-b70903bf-4428-4f55-95d4-d2a77294305a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Image limits 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:56:46.432751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-b70903bf-4428-4f55-95d4-d2a77294305a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Flavor pref 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:56:46.433168 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-b70903bf-4428-4f55-95d4-d2a77294305a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Image pref 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:56:46.433657 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-b70903bf-4428-4f55-95d4-d2a77294305a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:56:46.443294 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b70903bf-4428-4f55-95d4-d2a77294305a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:46.443777 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b70903bf-4428-4f55-95d4-d2a77294305a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:46.444642 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b70903bf-4428-4f55-95d4-d2a77294305a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:46.445088 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b70903bf-4428-4f55-95d4-d2a77294305a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:46.462794 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-b70903bf-4428-4f55-95d4-d2a77294305a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Getting quotas for project b493dbf75ed64a7dbda3e9c6a6168f8f. Resources: {'ram', 'cores', 'instances'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:56:46.466828 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-b70903bf-4428-4f55-95d4-d2a77294305a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Getting quotas for user b0eb46b0aeeb46fe8dcdb02f29ae4013 and project b493dbf75ed64a7dbda3e9c6a6168f8f. Resources: {'ram', 'cores', 'instances'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:56:46.479544 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-b70903bf-4428-4f55-95d4-d2a77294305a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Going to run 1 instances... {{(pid=129876) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:56:46.481835 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-b70903bf-4428-4f55-95d4-d2a77294305a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='978084c7-ed2c-4e42-ac8b-f5d19c4001fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:56:46.679366 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-b70903bf-4428-4f55-95d4-d2a77294305a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.900633 Jun 17 08:56:46.680043 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 366/728] 10.222.0.78 () {62 vars in 1187 bytes} [Fri Jun 17 08:56:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 17 08:56:46.690623 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-37fe67f2-bacd-41cc-9fd7-c2e08e0f4314 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:46.691660 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-37fe67f2-bacd-41cc-9fd7-c2e08e0f4314 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:46.694689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:46.859700 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-37fe67f2-bacd-41cc-9fd7-c2e08e0f4314 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:46.866962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-37fe67f2-bacd-41cc-9fd7-c2e08e0f4314 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:46.868491 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-37fe67f2-bacd-41cc-9fd7-c2e08e0f4314 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:46.869580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-37fe67f2-bacd-41cc-9fd7-c2e08e0f4314 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1281 microversion: 2.20 time: 0.183146 Jun 17 08:56:46.870139 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 363/729] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:56:46 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1281 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:56:47.887946 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-3f0614ba-7d58-40c3-9e4b-072c5cac7db3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:47.888563 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-3f0614ba-7d58-40c3-9e4b-072c5cac7db3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:47.898022 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3f0614ba-7d58-40c3-9e4b-072c5cac7db3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:47.898383 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3f0614ba-7d58-40c3-9e4b-072c5cac7db3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:47.899155 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3f0614ba-7d58-40c3-9e4b-072c5cac7db3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:47.899633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3f0614ba-7d58-40c3-9e4b-072c5cac7db3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:47.961497 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-3f0614ba-7d58-40c3-9e4b-072c5cac7db3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:47.969577 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-3f0614ba-7d58-40c3-9e4b-072c5cac7db3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:47.971134 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-3f0614ba-7d58-40c3-9e4b-072c5cac7db3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:47.972336 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-3f0614ba-7d58-40c3-9e4b-072c5cac7db3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1285 microversion: 2.20 time: 0.088795 Jun 17 08:56:47.973289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 367/730] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:56:47 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:56:48.990733 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-c8de1b16-4b24-43bc-93e2-726ab9722cb5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:48.991338 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-c8de1b16-4b24-43bc-93e2-726ab9722cb5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:48.997904 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c8de1b16-4b24-43bc-93e2-726ab9722cb5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:48.998350 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c8de1b16-4b24-43bc-93e2-726ab9722cb5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:48.999134 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c8de1b16-4b24-43bc-93e2-726ab9722cb5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:48.999600 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c8de1b16-4b24-43bc-93e2-726ab9722cb5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:49.063764 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c8de1b16-4b24-43bc-93e2-726ab9722cb5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:49.072298 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c8de1b16-4b24-43bc-93e2-726ab9722cb5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:49.073826 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c8de1b16-4b24-43bc-93e2-726ab9722cb5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:49.075028 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-c8de1b16-4b24-43bc-93e2-726ab9722cb5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1333 microversion: 2.20 time: 0.088944 Jun 17 08:56:49.075808 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 364/731] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:56:48 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1333 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:56:49.356066 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-2e2f176a-cd8c-4bc5-b657-d3adcf682c6e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a40ed135-1a4e-456d-a5dd-1ce31dee8d66"}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:56:49.357231 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-2e2f176a-cd8c-4bc5-b657-d3adcf682c6e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:49.363993 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2e2f176a-cd8c-4bc5-b657-d3adcf682c6e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:49.368322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2e2f176a-cd8c-4bc5-b657-d3adcf682c6e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:49.368322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2e2f176a-cd8c-4bc5-b657-d3adcf682c6e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:49.368322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2e2f176a-cd8c-4bc5-b657-d3adcf682c6e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:50.094169 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d8917d30-0444-47cc-8055-049b68613979 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:50.094887 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-d8917d30-0444-47cc-8055-049b68613979 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:50.102073 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d8917d30-0444-47cc-8055-049b68613979 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:50.102815 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d8917d30-0444-47cc-8055-049b68613979 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:50.103537 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d8917d30-0444-47cc-8055-049b68613979 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:50.104046 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d8917d30-0444-47cc-8055-049b68613979 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:50.186347 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d8917d30-0444-47cc-8055-049b68613979 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:50.194929 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d8917d30-0444-47cc-8055-049b68613979 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:50.196506 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d8917d30-0444-47cc-8055-049b68613979 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:50.197605 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-d8917d30-0444-47cc-8055-049b68613979 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1339 microversion: 2.20 time: 0.107488 Jun 17 08:56:50.198160 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 365/732] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:56:50 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1339 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:56:50.305914 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-2e2f176a-cd8c-4bc5-b657-d3adcf682c6e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "POST /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.953380 Jun 17 08:56:50.306826 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 368/733] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jun 17 08:56:49 2022] POST /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074/os-volume_attachments => generated 194 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:56:51.216087 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-abd967e0-9fef-4df4-a4b5-4723f032de0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:51.216701 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-abd967e0-9fef-4df4-a4b5-4723f032de0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:51.224967 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-abd967e0-9fef-4df4-a4b5-4723f032de0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:51.225466 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-abd967e0-9fef-4df4-a4b5-4723f032de0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:51.226233 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-abd967e0-9fef-4df4-a4b5-4723f032de0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:51.226719 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-abd967e0-9fef-4df4-a4b5-4723f032de0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:51.372250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-26a3f5b0-2e9e-4d78-9ddc-c331bfe30fbd req-42252d37-4fdb-48dc-8888-8efb6c1a29fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b18a4b5-273d-4ec1-81a8-ca670de385ea", "tag": "02d2e50f-49e7-4067-86ed-da24c07d5aea"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:56:51.395961 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:51.399981 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-26a3f5b0-2e9e-4d78-9ddc-c331bfe30fbd req-42252d37-4fdb-48dc-8888-8efb6c1a29fb service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:51.400661 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-26a3f5b0-2e9e-4d78-9ddc-c331bfe30fbd req-42252d37-4fdb-48dc-8888-8efb6c1a29fb service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:51.436815 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-26a3f5b0-2e9e-4d78-9ddc-c331bfe30fbd req-42252d37-4fdb-48dc-8888-8efb6c1a29fb service nova] Creating event network-changed:02d2e50f-49e7-4067-86ed-da24c07d5aea for instance 2b18a4b5-273d-4ec1-81a8-ca670de385ea on hv-cinder-79760 Jun 17 08:56:51.452186 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-26a3f5b0-2e9e-4d78-9ddc-c331bfe30fbd req-42252d37-4fdb-48dc-8888-8efb6c1a29fb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081138 Jun 17 08:56:51.453069 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 369/734] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:56:51.489504 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-abd967e0-9fef-4df4-a4b5-4723f032de0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:51.498629 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-abd967e0-9fef-4df4-a4b5-4723f032de0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:51.500165 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-abd967e0-9fef-4df4-a4b5-4723f032de0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:51.501305 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-abd967e0-9fef-4df4-a4b5-4723f032de0a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1406 microversion: 2.20 time: 0.289311 Jun 17 08:56:51.514947 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 366/735] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:56:51 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1406 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:56:52.522223 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-fcd3c4ad-8f17-49e9-8584-44f1a8cfadab tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:52.523669 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-fcd3c4ad-8f17-49e9-8584-44f1a8cfadab tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:52.531183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fcd3c4ad-8f17-49e9-8584-44f1a8cfadab tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:52.531899 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fcd3c4ad-8f17-49e9-8584-44f1a8cfadab tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:52.532868 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fcd3c4ad-8f17-49e9-8584-44f1a8cfadab tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:52.533858 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fcd3c4ad-8f17-49e9-8584-44f1a8cfadab tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:52.667592 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-fcd3c4ad-8f17-49e9-8584-44f1a8cfadab tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:52.675450 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-fcd3c4ad-8f17-49e9-8584-44f1a8cfadab tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:52.676938 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-fcd3c4ad-8f17-49e9-8584-44f1a8cfadab tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:52.678045 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-fcd3c4ad-8f17-49e9-8584-44f1a8cfadab tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1406 microversion: 2.20 time: 0.162035 Jun 17 08:56:52.678590 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 370/736] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:56:52 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:56:53.696213 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a51cf142-8c33-41ab-8857-9fc271e90779 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:53.696923 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-a51cf142-8c33-41ab-8857-9fc271e90779 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:53.703631 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a51cf142-8c33-41ab-8857-9fc271e90779 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:53.704012 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a51cf142-8c33-41ab-8857-9fc271e90779 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:53.704781 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a51cf142-8c33-41ab-8857-9fc271e90779 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:53.705216 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a51cf142-8c33-41ab-8857-9fc271e90779 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:53.843766 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a51cf142-8c33-41ab-8857-9fc271e90779 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:53.852512 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a51cf142-8c33-41ab-8857-9fc271e90779 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:53.854005 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a51cf142-8c33-41ab-8857-9fc271e90779 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:53.855119 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-a51cf142-8c33-41ab-8857-9fc271e90779 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1406 microversion: 2.20 time: 0.162895 Jun 17 08:56:53.855734 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 367/737] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:56:53 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:56:54.928472 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-8e0e0043-ceac-4dba-8839-5cc690fe863c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:54.929080 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-8e0e0043-ceac-4dba-8839-5cc690fe863c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:54.935495 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8e0e0043-ceac-4dba-8839-5cc690fe863c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:54.935945 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8e0e0043-ceac-4dba-8839-5cc690fe863c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:54.936796 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8e0e0043-ceac-4dba-8839-5cc690fe863c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:54.937229 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8e0e0043-ceac-4dba-8839-5cc690fe863c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:55.066736 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-8e0e0043-ceac-4dba-8839-5cc690fe863c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:55.074784 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-8e0e0043-ceac-4dba-8839-5cc690fe863c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:55.076292 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-8e0e0043-ceac-4dba-8839-5cc690fe863c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:55.077399 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-8e0e0043-ceac-4dba-8839-5cc690fe863c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1406 microversion: 2.20 time: 0.208229 Jun 17 08:56:55.077971 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 371/738] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:56:54 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:56:56.095393 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-49e218e4-887e-477e-bc03-f11164b674d0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:56.096001 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-49e218e4-887e-477e-bc03-f11164b674d0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:56.104627 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-49e218e4-887e-477e-bc03-f11164b674d0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:56.105085 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-49e218e4-887e-477e-bc03-f11164b674d0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:56.105871 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-49e218e4-887e-477e-bc03-f11164b674d0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:56.106452 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-49e218e4-887e-477e-bc03-f11164b674d0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:56.240395 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-49e218e4-887e-477e-bc03-f11164b674d0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:56.248468 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-49e218e4-887e-477e-bc03-f11164b674d0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:56.249956 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-49e218e4-887e-477e-bc03-f11164b674d0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:56.254346 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-49e218e4-887e-477e-bc03-f11164b674d0 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1406 microversion: 2.20 time: 0.159791 Jun 17 08:56:56.254346 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 368/739] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:56:56 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:56:57.270112 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-4d203e35-f046-4261-ace9-2b92d1291e33 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:57.270781 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-4d203e35-f046-4261-ace9-2b92d1291e33 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:57.273299 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=2 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:57.273972 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=6 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:57.278835 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4d203e35-f046-4261-ace9-2b92d1291e33 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:57.279280 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4d203e35-f046-4261-ace9-2b92d1291e33 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:57.280075 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4d203e35-f046-4261-ace9-2b92d1291e33 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:57.280508 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4d203e35-f046-4261-ace9-2b92d1291e33 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:57.416922 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-4d203e35-f046-4261-ace9-2b92d1291e33 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:57.426504 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-4d203e35-f046-4261-ace9-2b92d1291e33 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:57.429801 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-4d203e35-f046-4261-ace9-2b92d1291e33 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:57.429801 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-4d203e35-f046-4261-ace9-2b92d1291e33 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1406 microversion: 2.20 time: 0.163845 Jun 17 08:56:57.430315 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 372/740] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:56:57 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:56:57.923383 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-858c5222-d9fc-4fa5-b758-c41bca90d30e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:56:57.924338 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-858c5222-d9fc-4fa5-b758-c41bca90d30e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:57.927025 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=6 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:57.944988 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-858c5222-d9fc-4fa5-b758-c41bca90d30e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:57.945452 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-858c5222-d9fc-4fa5-b758-c41bca90d30e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:57.946220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-858c5222-d9fc-4fa5-b758-c41bca90d30e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:57.946655 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-858c5222-d9fc-4fa5-b758-c41bca90d30e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:57.969770 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-858c5222-d9fc-4fa5-b758-c41bca90d30e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lazy-loading 'flavor' on Instance uuid 1eb89053-6d2e-47f4-a675-6254d182e074 {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:56:58.005871 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-8014e8ca-edb0-4a5f-bbea-9753cc5f857a req-2a010c06-d018-4115-887f-1ca47147fe05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b18a4b5-273d-4ec1-81a8-ca670de385ea", "name": "network-vif-plugged", "status": "completed", "tag": "02d2e50f-49e7-4067-86ed-da24c07d5aea"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:56:58.014746 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-8014e8ca-edb0-4a5f-bbea-9753cc5f857a req-2a010c06-d018-4115-887f-1ca47147fe05 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:58.015194 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-8014e8ca-edb0-4a5f-bbea-9753cc5f857a req-2a010c06-d018-4115-887f-1ca47147fe05 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:58.027492 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-8014e8ca-edb0-4a5f-bbea-9753cc5f857a req-2a010c06-d018-4115-887f-1ca47147fe05 service nova] Creating event network-vif-plugged:02d2e50f-49e7-4067-86ed-da24c07d5aea for instance 2b18a4b5-273d-4ec1-81a8-ca670de385ea on hv-cinder-79760 Jun 17 08:56:58.032209 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-8014e8ca-edb0-4a5f-bbea-9753cc5f857a req-2a010c06-d018-4115-887f-1ca47147fe05 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030497 Jun 17 08:56:58.036025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 373/741] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:56:58.449686 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e4e49b14-807d-4f57-8be8-6c32bbd81b15 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:58.450358 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-e4e49b14-807d-4f57-8be8-6c32bbd81b15 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:58.457249 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e4e49b14-807d-4f57-8be8-6c32bbd81b15 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:58.457724 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e4e49b14-807d-4f57-8be8-6c32bbd81b15 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:58.458496 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e4e49b14-807d-4f57-8be8-6c32bbd81b15 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:58.458936 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e4e49b14-807d-4f57-8be8-6c32bbd81b15 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:58.461705 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:58.475815 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-858c5222-d9fc-4fa5-b758-c41bca90d30e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "POST /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074/action" status: 200 len: 32 microversion: 2.1 time: 0.556383 Jun 17 08:56:58.482734 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 369/742] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jun 17 08:56:57 2022] POST /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074/action => generated 32 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 08:56:58.489078 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-2644d551-9dfc-493c-8345-4c86202fc3cd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:58.490774 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-2644d551-9dfc-493c-8345-4c86202fc3cd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:58.498847 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2644d551-9dfc-493c-8345-4c86202fc3cd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:58.499404 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2644d551-9dfc-493c-8345-4c86202fc3cd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:58.500283 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2644d551-9dfc-493c-8345-4c86202fc3cd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:58.500825 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2644d551-9dfc-493c-8345-4c86202fc3cd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:58.686219 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e4e49b14-807d-4f57-8be8-6c32bbd81b15 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:58.689297 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2644d551-9dfc-493c-8345-4c86202fc3cd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:58.695288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e4e49b14-807d-4f57-8be8-6c32bbd81b15 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:58.696955 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e4e49b14-807d-4f57-8be8-6c32bbd81b15 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:58.697871 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-2644d551-9dfc-493c-8345-4c86202fc3cd tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1735 microversion: 2.1 time: 0.213619 Jun 17 08:56:58.698076 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-e4e49b14-807d-4f57-8be8-6c32bbd81b15 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1406 microversion: 2.20 time: 0.253715 Jun 17 08:56:58.698458 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 370/743] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:58 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:58.698611 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 374/744] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:56:58 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1406 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:56:59.715607 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-062a11b3-bb17-43ff-9f81-46c22408eed1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:59.717001 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-062a11b3-bb17-43ff-9f81-46c22408eed1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:59.717220 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-9d9d94e3-71b0-480d-b7fa-cbd0d18004f5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:59.718326 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-9d9d94e3-71b0-480d-b7fa-cbd0d18004f5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:59.724649 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-062a11b3-bb17-43ff-9f81-46c22408eed1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:59.725939 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-062a11b3-bb17-43ff-9f81-46c22408eed1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:59.726105 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9d9d94e3-71b0-480d-b7fa-cbd0d18004f5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:59.726469 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9d9d94e3-71b0-480d-b7fa-cbd0d18004f5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:59.727608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9d9d94e3-71b0-480d-b7fa-cbd0d18004f5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:59.728252 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9d9d94e3-71b0-480d-b7fa-cbd0d18004f5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:59.728368 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-062a11b3-bb17-43ff-9f81-46c22408eed1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:59.728837 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-062a11b3-bb17-43ff-9f81-46c22408eed1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:59.927621 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-062a11b3-bb17-43ff-9f81-46c22408eed1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:59.930717 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-9d9d94e3-71b0-480d-b7fa-cbd0d18004f5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:59.936375 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-062a11b3-bb17-43ff-9f81-46c22408eed1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1735 microversion: 2.1 time: 0.224863 Jun 17 08:56:59.937143 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 371/745] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:59 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:59.939022 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-9d9d94e3-71b0-480d-b7fa-cbd0d18004f5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:59.940589 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-9d9d94e3-71b0-480d-b7fa-cbd0d18004f5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:59.941870 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-9d9d94e3-71b0-480d-b7fa-cbd0d18004f5 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1406 microversion: 2.20 time: 0.228820 Jun 17 08:56:59.942412 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 375/746] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:56:59 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:57:00.953954 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1be1b426-0d53-4a8f-b89d-e751c14efab5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:00.954598 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-1be1b426-0d53-4a8f-b89d-e751c14efab5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:00.959781 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-90472cb1-499f-4e29-bb4c-c9ec73bba665 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:00.960434 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-90472cb1-499f-4e29-bb4c-c9ec73bba665 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:00.962498 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1be1b426-0d53-4a8f-b89d-e751c14efab5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:00.962951 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1be1b426-0d53-4a8f-b89d-e751c14efab5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:00.963753 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1be1b426-0d53-4a8f-b89d-e751c14efab5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:00.964194 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1be1b426-0d53-4a8f-b89d-e751c14efab5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:00.966920 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-90472cb1-499f-4e29-bb4c-c9ec73bba665 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:00.967399 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-90472cb1-499f-4e29-bb4c-c9ec73bba665 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:00.968187 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-90472cb1-499f-4e29-bb4c-c9ec73bba665 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:00.968631 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-90472cb1-499f-4e29-bb4c-c9ec73bba665 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:01.156346 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-90472cb1-499f-4e29-bb4c-c9ec73bba665 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:01.163053 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-1be1b426-0d53-4a8f-b89d-e751c14efab5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:01.164388 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-90472cb1-499f-4e29-bb4c-c9ec73bba665 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:01.165880 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-90472cb1-499f-4e29-bb4c-c9ec73bba665 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:01.167031 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-90472cb1-499f-4e29-bb4c-c9ec73bba665 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1598 microversion: 2.20 time: 0.211801 Jun 17 08:57:01.167603 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 376/747] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:57:00 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1598 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:57:01.171295 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-1be1b426-0d53-4a8f-b89d-e751c14efab5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1735 microversion: 2.1 time: 0.221469 Jun 17 08:57:01.171981 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 372/748] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:00 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1735 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:01.185176 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-9795d59a-de33-4ce1-8c05-ce372391e3dd tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:01.185697 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-9795d59a-de33-4ce1-8c05-ce372391e3dd tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:01.192274 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9795d59a-de33-4ce1-8c05-ce372391e3dd tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:01.192715 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9795d59a-de33-4ce1-8c05-ce372391e3dd tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:01.193473 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9795d59a-de33-4ce1-8c05-ce372391e3dd tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:01.193909 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9795d59a-de33-4ce1-8c05-ce372391e3dd tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:01.268988 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-9795d59a-de33-4ce1-8c05-ce372391e3dd tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.087645 Jun 17 08:57:01.269623 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 377/749] 10.222.0.78 () {60 vars in 1315 bytes} [Fri Jun 17 08:57:01 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:57:02.189308 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-6305e93a-3282-44b6-8ee1-7aed1d1456e5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:02.189931 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-6305e93a-3282-44b6-8ee1-7aed1d1456e5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:02.197178 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6305e93a-3282-44b6-8ee1-7aed1d1456e5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:02.197725 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6305e93a-3282-44b6-8ee1-7aed1d1456e5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:02.198513 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6305e93a-3282-44b6-8ee1-7aed1d1456e5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:02.198945 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6305e93a-3282-44b6-8ee1-7aed1d1456e5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:02.353413 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-9f0c8d52-c81c-48a5-a0d6-f0c9c6946a29 req-f7e04c58-8f3e-4ef9-b5ed-7698742856c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b18a4b5-273d-4ec1-81a8-ca670de385ea", "tag": "02d2e50f-49e7-4067-86ed-da24c07d5aea"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:57:02.361830 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-9f0c8d52-c81c-48a5-a0d6-f0c9c6946a29 req-f7e04c58-8f3e-4ef9-b5ed-7698742856c9 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:02.362431 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-9f0c8d52-c81c-48a5-a0d6-f0c9c6946a29 req-f7e04c58-8f3e-4ef9-b5ed-7698742856c9 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:02.377278 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-6305e93a-3282-44b6-8ee1-7aed1d1456e5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:02.381335 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-9f0c8d52-c81c-48a5-a0d6-f0c9c6946a29 req-f7e04c58-8f3e-4ef9-b5ed-7698742856c9 service nova] Creating event network-changed:02d2e50f-49e7-4067-86ed-da24c07d5aea for instance 2b18a4b5-273d-4ec1-81a8-ca670de385ea on hv-cinder-79760 Jun 17 08:57:02.386425 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-9f0c8d52-c81c-48a5-a0d6-f0c9c6946a29 req-f7e04c58-8f3e-4ef9-b5ed-7698742856c9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037405 Jun 17 08:57:02.391667 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 378/750] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:57:02.392135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-6305e93a-3282-44b6-8ee1-7aed1d1456e5 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1735 microversion: 2.1 time: 0.201886 Jun 17 08:57:02.392135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 373/751] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:02 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:03.409351 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-52e0bfb9-4cd7-4dcd-a032-bd12ac100edc tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:03.410213 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-52e0bfb9-4cd7-4dcd-a032-bd12ac100edc tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:03.416724 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-52e0bfb9-4cd7-4dcd-a032-bd12ac100edc tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:03.417409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-52e0bfb9-4cd7-4dcd-a032-bd12ac100edc tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:03.419990 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-52e0bfb9-4cd7-4dcd-a032-bd12ac100edc tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:03.420442 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-52e0bfb9-4cd7-4dcd-a032-bd12ac100edc tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:03.595479 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-52e0bfb9-4cd7-4dcd-a032-bd12ac100edc tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:03.604251 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-52e0bfb9-4cd7-4dcd-a032-bd12ac100edc tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1735 microversion: 2.1 time: 0.200084 Jun 17 08:57:03.604840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 379/752] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:03 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:04.627875 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-fa4ecfb9-9704-48ab-be07-ff8921932f91 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:04.629069 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-fa4ecfb9-9704-48ab-be07-ff8921932f91 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:04.635509 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fa4ecfb9-9704-48ab-be07-ff8921932f91 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:04.635888 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fa4ecfb9-9704-48ab-be07-ff8921932f91 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:04.636659 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fa4ecfb9-9704-48ab-be07-ff8921932f91 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:04.637098 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fa4ecfb9-9704-48ab-be07-ff8921932f91 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:04.770729 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-fa4ecfb9-9704-48ab-be07-ff8921932f91 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:04.778567 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-fa4ecfb9-9704-48ab-be07-ff8921932f91 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1735 microversion: 2.1 time: 0.154606 Jun 17 08:57:04.779125 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 374/753] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:04 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:05.796142 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-dc465600-28f2-4b41-a625-808abf0b46ee tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:05.796861 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-dc465600-28f2-4b41-a625-808abf0b46ee tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:05.806567 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dc465600-28f2-4b41-a625-808abf0b46ee tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:05.807182 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dc465600-28f2-4b41-a625-808abf0b46ee tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:05.808397 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dc465600-28f2-4b41-a625-808abf0b46ee tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:05.808973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dc465600-28f2-4b41-a625-808abf0b46ee tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:05.945989 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-dc465600-28f2-4b41-a625-808abf0b46ee tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:05.953919 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-dc465600-28f2-4b41-a625-808abf0b46ee tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1735 microversion: 2.1 time: 0.162409 Jun 17 08:57:05.954487 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 380/754] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:05 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:06.971116 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-5d2ae74b-abb2-4f81-92bd-b468c2d14055 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:06.971865 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-5d2ae74b-abb2-4f81-92bd-b468c2d14055 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:06.978393 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5d2ae74b-abb2-4f81-92bd-b468c2d14055 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:06.978838 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5d2ae74b-abb2-4f81-92bd-b468c2d14055 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:06.979628 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5d2ae74b-abb2-4f81-92bd-b468c2d14055 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:06.980066 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5d2ae74b-abb2-4f81-92bd-b468c2d14055 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:07.116002 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-5d2ae74b-abb2-4f81-92bd-b468c2d14055 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:07.124003 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-5d2ae74b-abb2-4f81-92bd-b468c2d14055 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1735 microversion: 2.1 time: 0.156915 Jun 17 08:57:07.124559 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 375/755] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:06 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:08.142173 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a6cf9f78-ae68-40e9-9827-0e85bd23aef1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:08.142738 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a6cf9f78-ae68-40e9-9827-0e85bd23aef1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:08.149479 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a6cf9f78-ae68-40e9-9827-0e85bd23aef1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:08.149931 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a6cf9f78-ae68-40e9-9827-0e85bd23aef1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:08.150698 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a6cf9f78-ae68-40e9-9827-0e85bd23aef1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:08.151140 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a6cf9f78-ae68-40e9-9827-0e85bd23aef1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:08.284116 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a6cf9f78-ae68-40e9-9827-0e85bd23aef1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:08.292916 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a6cf9f78-ae68-40e9-9827-0e85bd23aef1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1735 microversion: 2.1 time: 0.154648 Jun 17 08:57:08.293482 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 381/756] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:08 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:09.311134 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1a7080cc-81f0-45ab-a8f8-fe64e9f4a4c3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:09.311744 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-1a7080cc-81f0-45ab-a8f8-fe64e9f4a4c3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:09.318750 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1a7080cc-81f0-45ab-a8f8-fe64e9f4a4c3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:09.319196 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1a7080cc-81f0-45ab-a8f8-fe64e9f4a4c3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:09.319986 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1a7080cc-81f0-45ab-a8f8-fe64e9f4a4c3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:09.320419 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1a7080cc-81f0-45ab-a8f8-fe64e9f4a4c3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:09.447284 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-1a7080cc-81f0-45ab-a8f8-fe64e9f4a4c3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:09.455459 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-1a7080cc-81f0-45ab-a8f8-fe64e9f4a4c3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1735 microversion: 2.1 time: 0.148362 Jun 17 08:57:09.456513 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 376/757] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:09 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:10.474023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-d0fcd0a6-9648-4665-b6fd-07e129716e83 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:10.474741 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-d0fcd0a6-9648-4665-b6fd-07e129716e83 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:10.481398 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d0fcd0a6-9648-4665-b6fd-07e129716e83 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:10.481856 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d0fcd0a6-9648-4665-b6fd-07e129716e83 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:10.482630 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d0fcd0a6-9648-4665-b6fd-07e129716e83 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:10.483073 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d0fcd0a6-9648-4665-b6fd-07e129716e83 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:10.613683 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-d0fcd0a6-9648-4665-b6fd-07e129716e83 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:10.621711 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-d0fcd0a6-9648-4665-b6fd-07e129716e83 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1735 microversion: 2.1 time: 0.152158 Jun 17 08:57:10.622280 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 382/758] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:10 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:11.639108 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-36d754b3-aea6-4b84-afb1-aed248ea5d46 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:11.639763 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-36d754b3-aea6-4b84-afb1-aed248ea5d46 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:11.646746 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-36d754b3-aea6-4b84-afb1-aed248ea5d46 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:11.647200 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-36d754b3-aea6-4b84-afb1-aed248ea5d46 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:11.648006 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-36d754b3-aea6-4b84-afb1-aed248ea5d46 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:11.648448 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-36d754b3-aea6-4b84-afb1-aed248ea5d46 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:11.780416 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-36d754b3-aea6-4b84-afb1-aed248ea5d46 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:11.782657 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:11.789010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-36d754b3-aea6-4b84-afb1-aed248ea5d46 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1735 microversion: 2.1 time: 0.153804 Jun 17 08:57:11.789567 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 377/759] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:11 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:12.806197 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-1506fb09-60e6-42d4-b42a-89047cbaffd0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:12.806822 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-1506fb09-60e6-42d4-b42a-89047cbaffd0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:12.813522 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1506fb09-60e6-42d4-b42a-89047cbaffd0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:12.813969 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1506fb09-60e6-42d4-b42a-89047cbaffd0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:12.814723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1506fb09-60e6-42d4-b42a-89047cbaffd0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:12.815157 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1506fb09-60e6-42d4-b42a-89047cbaffd0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:12.949769 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-1506fb09-60e6-42d4-b42a-89047cbaffd0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:12.958443 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-1506fb09-60e6-42d4-b42a-89047cbaffd0 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1735 microversion: 2.1 time: 0.156096 Jun 17 08:57:12.959004 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 383/760] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:12 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:13.976153 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-c6de1e09-9ecf-4df0-b6a1-0be7f6b71350 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:13.976758 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-c6de1e09-9ecf-4df0-b6a1-0be7f6b71350 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:13.983911 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c6de1e09-9ecf-4df0-b6a1-0be7f6b71350 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:13.984355 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c6de1e09-9ecf-4df0-b6a1-0be7f6b71350 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:13.985404 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c6de1e09-9ecf-4df0-b6a1-0be7f6b71350 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:13.985838 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c6de1e09-9ecf-4df0-b6a1-0be7f6b71350 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:14.118478 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c6de1e09-9ecf-4df0-b6a1-0be7f6b71350 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:14.126652 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-c6de1e09-9ecf-4df0-b6a1-0be7f6b71350 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1735 microversion: 2.1 time: 0.154385 Jun 17 08:57:14.127212 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 378/761] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:13 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:14.381018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-f10be17d-6bd9-488b-b5c7-0b5a9fcbf575 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2105065718"}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:57:14.381554 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-f10be17d-6bd9-488b-b5c7-0b5a9fcbf575 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:14.388399 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f10be17d-6bd9-488b-b5c7-0b5a9fcbf575 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:14.393428 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f10be17d-6bd9-488b-b5c7-0b5a9fcbf575 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:14.393428 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f10be17d-6bd9-488b-b5c7-0b5a9fcbf575 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:14.393428 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f10be17d-6bd9-488b-b5c7-0b5a9fcbf575 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:14.517299 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.network.security_group_api [None req-f10be17d-6bd9-488b-b5c7-0b5a9fcbf575 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Removing security group 2bec96a3-5e42-48e6-a407-554f225e05bd from port 5a6e2dcc-1d88-4ebd-8cce-063737a7db08 Jun 17 08:57:14.940530 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-f10be17d-6bd9-488b-b5c7-0b5a9fcbf575 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "POST /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d/action" status: 202 len: 0 microversion: 2.1 time: 0.563971 Jun 17 08:57:14.946194 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 384/762] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jun 17 08:57:14 2022] POST /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d/action => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:57:15.146486 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-0e87bdd4-648a-4d92-a97e-da2f894f04a3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:15.151084 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-0e87bdd4-648a-4d92-a97e-da2f894f04a3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:15.159699 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0e87bdd4-648a-4d92-a97e-da2f894f04a3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:15.160287 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0e87bdd4-648a-4d92-a97e-da2f894f04a3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:15.161158 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0e87bdd4-648a-4d92-a97e-da2f894f04a3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:15.161777 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0e87bdd4-648a-4d92-a97e-da2f894f04a3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:15.228823 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-96c8d2c2-f21a-4435-b02f-3c8fb49b4b6f req-701ca9d5-8894-430d-b660-41a6cbbe5021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e254b695-5369-48d6-9966-64f25873dc0d", "tag": "5a6e2dcc-1d88-4ebd-8cce-063737a7db08"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:57:15.236288 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-96c8d2c2-f21a-4435-b02f-3c8fb49b4b6f req-701ca9d5-8894-430d-b660-41a6cbbe5021 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:15.236731 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-96c8d2c2-f21a-4435-b02f-3c8fb49b4b6f req-701ca9d5-8894-430d-b660-41a6cbbe5021 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:15.249675 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-96c8d2c2-f21a-4435-b02f-3c8fb49b4b6f req-701ca9d5-8894-430d-b660-41a6cbbe5021 service nova] Creating event network-changed:5a6e2dcc-1d88-4ebd-8cce-063737a7db08 for instance e254b695-5369-48d6-9966-64f25873dc0d on hv-cinder-79760 Jun 17 08:57:15.258816 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-96c8d2c2-f21a-4435-b02f-3c8fb49b4b6f req-701ca9d5-8894-430d-b660-41a6cbbe5021 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.300810 Jun 17 08:57:15.259869 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 379/763] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:57:15.630697 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-0e87bdd4-648a-4d92-a97e-da2f894f04a3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:15.639144 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-0e87bdd4-648a-4d92-a97e-da2f894f04a3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1735 microversion: 2.1 time: 0.496618 Jun 17 08:57:15.639941 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 385/764] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:15 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1735 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:16.659546 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d1148227-aebe-4443-881e-72cc656e77ff tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:16.660276 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-d1148227-aebe-4443-881e-72cc656e77ff tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:16.668209 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d1148227-aebe-4443-881e-72cc656e77ff tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:16.668665 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d1148227-aebe-4443-881e-72cc656e77ff tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:16.669445 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d1148227-aebe-4443-881e-72cc656e77ff tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:16.669886 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d1148227-aebe-4443-881e-72cc656e77ff tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:16.835087 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a90711f4-2ab7-4b02-8860-118d93ef5180 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:16.835713 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a90711f4-2ab7-4b02-8860-118d93ef5180 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:16.842791 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a90711f4-2ab7-4b02-8860-118d93ef5180 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:16.843288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a90711f4-2ab7-4b02-8860-118d93ef5180 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:16.844178 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a90711f4-2ab7-4b02-8860-118d93ef5180 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:16.844630 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a90711f4-2ab7-4b02-8860-118d93ef5180 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:16.846043 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d1148227-aebe-4443-881e-72cc656e77ff tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:16.854863 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-d1148227-aebe-4443-881e-72cc656e77ff tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1735 microversion: 2.1 time: 0.201011 Jun 17 08:57:16.859580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 380/765] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:16 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1735 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:16.928195 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.objects.instance [None req-a90711f4-2ab7-4b02-8860-118d93ef5180 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lazy-loading 'services' on Instance uuid e254b695-5369-48d6-9966-64f25873dc0d {{(pid=129876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:57:17.133240 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a90711f4-2ab7-4b02-8860-118d93ef5180 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d/os-volume_attachments/453aa64e-9de7-464f-8c8e-6870c2488c57" status: 202 len: 0 microversion: 2.1 time: 0.302745 Jun 17 08:57:17.133842 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 386/766] 10.222.0.78 () {58 vars in 1415 bytes} [Fri Jun 17 08:57:16 2022] DELETE /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d/os-volume_attachments/453aa64e-9de7-464f-8c8e-6870c2488c57 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 08:57:17.144066 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1bae3ab3-0071-4652-a308-46aa8cbde0de tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:17.145224 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-1bae3ab3-0071-4652-a308-46aa8cbde0de tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:17.150012 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=38 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:17.154020 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1bae3ab3-0071-4652-a308-46aa8cbde0de tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:17.154504 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1bae3ab3-0071-4652-a308-46aa8cbde0de tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:17.155436 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1bae3ab3-0071-4652-a308-46aa8cbde0de tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:17.155872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1bae3ab3-0071-4652-a308-46aa8cbde0de tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:17.187540 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-1bae3ab3-0071-4652-a308-46aa8cbde0de tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049145 Jun 17 08:57:17.188138 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 381/767] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 08:57:17 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:57:17.277446 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-68111049-d345-49db-a3eb-00e9de13d2c8 req-1843dc21-5683-4762-8ccd-dffe58749f14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e254b695-5369-48d6-9966-64f25873dc0d", "tag": "5a6e2dcc-1d88-4ebd-8cce-063737a7db08"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:57:17.288798 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-68111049-d345-49db-a3eb-00e9de13d2c8 req-1843dc21-5683-4762-8ccd-dffe58749f14 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:17.289778 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-68111049-d345-49db-a3eb-00e9de13d2c8 req-1843dc21-5683-4762-8ccd-dffe58749f14 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:17.303234 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-68111049-d345-49db-a3eb-00e9de13d2c8 req-1843dc21-5683-4762-8ccd-dffe58749f14 service nova] Creating event network-changed:5a6e2dcc-1d88-4ebd-8cce-063737a7db08 for instance e254b695-5369-48d6-9966-64f25873dc0d on hv-cinder-79760 Jun 17 08:57:17.308518 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-68111049-d345-49db-a3eb-00e9de13d2c8 req-1843dc21-5683-4762-8ccd-dffe58749f14 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036009 Jun 17 08:57:17.309414 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 387/768] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:57:17.872939 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-43909286-c69f-4559-a06a-abdc6a8e67b9 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:17.873589 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-43909286-c69f-4559-a06a-abdc6a8e67b9 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:17.883815 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-43909286-c69f-4559-a06a-abdc6a8e67b9 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:17.884271 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-43909286-c69f-4559-a06a-abdc6a8e67b9 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:17.885172 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-43909286-c69f-4559-a06a-abdc6a8e67b9 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:17.885625 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-43909286-c69f-4559-a06a-abdc6a8e67b9 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:18.108328 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-43909286-c69f-4559-a06a-abdc6a8e67b9 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:18.116612 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-43909286-c69f-4559-a06a-abdc6a8e67b9 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1735 microversion: 2.1 time: 0.247811 Jun 17 08:57:18.117205 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 382/769] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:17 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1735 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:18.202058 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a7eda9b2-b622-4204-842f-13fabd5389d7 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:18.203187 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a7eda9b2-b622-4204-842f-13fabd5389d7 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:18.209899 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a7eda9b2-b622-4204-842f-13fabd5389d7 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:18.210442 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a7eda9b2-b622-4204-842f-13fabd5389d7 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:18.211249 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a7eda9b2-b622-4204-842f-13fabd5389d7 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:18.211716 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a7eda9b2-b622-4204-842f-13fabd5389d7 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:18.243682 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a7eda9b2-b622-4204-842f-13fabd5389d7 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046920 Jun 17 08:57:18.244505 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 388/770] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 08:57:18 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:57:19.134899 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-182983e4-2df8-444e-9737-80d0caf6aa38 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:19.135513 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-182983e4-2df8-444e-9737-80d0caf6aa38 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:19.142237 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-182983e4-2df8-444e-9737-80d0caf6aa38 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:19.142684 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-182983e4-2df8-444e-9737-80d0caf6aa38 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:19.143982 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-182983e4-2df8-444e-9737-80d0caf6aa38 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:19.144413 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-182983e4-2df8-444e-9737-80d0caf6aa38 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:19.255700 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-8976d7e8-2ae4-4c5e-957f-9caebc627be6 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:19.256649 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-8976d7e8-2ae4-4c5e-957f-9caebc627be6 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:19.263381 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8976d7e8-2ae4-4c5e-957f-9caebc627be6 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:19.264146 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8976d7e8-2ae4-4c5e-957f-9caebc627be6 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:19.264943 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8976d7e8-2ae4-4c5e-957f-9caebc627be6 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:19.265385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8976d7e8-2ae4-4c5e-957f-9caebc627be6 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:19.289043 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-182983e4-2df8-444e-9737-80d0caf6aa38 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:19.298196 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-8976d7e8-2ae4-4c5e-957f-9caebc627be6 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045550 Jun 17 08:57:19.298196 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 389/771] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 08:57:19 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 17 08:57:19.298912 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-182983e4-2df8-444e-9737-80d0caf6aa38 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1735 microversion: 2.1 time: 0.167352 Jun 17 08:57:19.299707 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 383/772] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:19 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:19.309875 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-d6918323-d026-4789-992d-d05d02fc2a84 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:19.310467 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-d6918323-d026-4789-992d-d05d02fc2a84 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:19.317265 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d6918323-d026-4789-992d-d05d02fc2a84 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:19.317812 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d6918323-d026-4789-992d-d05d02fc2a84 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:19.318660 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d6918323-d026-4789-992d-d05d02fc2a84 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:19.319180 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d6918323-d026-4789-992d-d05d02fc2a84 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:19.398823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-d6918323-d026-4789-992d-d05d02fc2a84 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] HTTP exception thrown: Instance e254b695-5369-48d6-9966-64f25873dc0d is not attached to volume 453aa64e-9de7-464f-8c8e-6870c2488c57 Jun 17 08:57:19.401253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-d6918323-d026-4789-992d-d05d02fc2a84 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Request method failure captured: Jun 17 08:57:19.401253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: DELETE /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d/os-volume_attachments/453aa64e-9de7-464f-8c8e-6870c2488c57 HTTP/1.1 Jun 17 08:57:19.401253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:57:19.401253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:57:19.401253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:57:19.401253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 08:57:19.401253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:57:19.401253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:57:19.401253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:57:19.401253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:57:19.401253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirEESjVMoWJpfwBg3ytQthC9tOn9nSPCtMw1EErUPzePdh_f_-vuL1ldQKHq7qy_HbWla5OsAgUuVBXydC9okxKcegfrcR9aqGOw1OB87_BFExZbI9lq5vYSY-8h_MMfr5S75B7XUtV02Q2zJx9IpZzS8dzscvTYZ_HSQsDOXnyVmQJw Jun 17 08:57:19.401253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:57:19.401253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:57:19.401253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:57:19.401253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:57:19.401253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:57:19.401253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:57:19.401253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: 45a0a44acc444e8eb9bba54a8e089f17 Jun 17 08:57:19.401253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-TestMinimumBasicScenario-1343982915 Jun 17 08:57:19.401253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:57:19.401253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:57:19.404845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/45a0a44acc444e8eb9bba54a8e089f17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/45a0a44acc444e8eb9bba54a8e089f17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_45a0a44acc444e8eb9bba54a8e089f17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/45a0a44acc444e8eb9bba54a8e089f17"}]}] Jun 17 08:57:19.404845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-TestMinimumBasicScenario-1343982915 Jun 17 08:57:19.404845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: 45a0a44acc444e8eb9bba54a8e089f17 Jun 17 08:57:19.404845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1343982915 Jun 17 08:57:19.404845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-TestMinimumBasicScenario-1343982915-project Jun 17 08:57:19.404845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:57:19.404845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:57:19.404845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: b9ab8c84c68b4275b2f81b69d8a52826 Jun 17 08:57:19.404845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-TestMinimumBasicScenario-1343982915-project Jun 17 08:57:19.404845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 08:57:19.404845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Instance e254b695-5369-48d6-9966-64f25873dc0d is not attached to volume 453aa64e-9de7-464f-8c8e-6870c2488c57 Jun 17 08:57:19.405723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'server_id': 'e254b695-5369-48d6-9966-64f25873dc0d', 'id': '453aa64e-9de7-464f-8c8e-6870c2488c57'} Jun 17 08:57:19.405723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:57:19.405723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:57:19.405723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 17 08:57:19.405723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 17 08:57:19.405723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 08:57:19.405723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 08:57:19.405723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 17 08:57:19.405723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 17 08:57:19.405723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 453aa64e-9de7-464f-8c8e-6870c2488c57. Jun 17 08:57:19.405723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:57:19.405723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:57:19.405723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:57:19.405723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:57:19.405723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:57:19.405723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:57:19.405723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:57:19.405723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:57:19.405723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:57:19.407934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:57:19.407934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 17 08:57:19.407934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 17 08:57:19.407934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e254b695-5369-48d6-9966-64f25873dc0d is not attached to volume 453aa64e-9de7-464f-8c8e-6870c2488c57 Jun 17 08:57:19.407934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:57:19.407934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:57:19.407934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:57:19.407934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:57:19.407934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:57:19.407934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:57:19.407934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:57:19.407934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:57:19.407934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e254b695-5369-48d6-9966-64f25873dc0d is not attached to volume 453aa64e-9de7-464f-8c8e-6870c2488c57 Jun 17 08:57:19.407934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:57:19.407934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-d6918323-d026-4789-992d-d05d02fc2a84 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Returning 404 to user: Instance e254b695-5369-48d6-9966-64f25873dc0d is not attached to volume 453aa64e-9de7-464f-8c8e-6870c2488c57 {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:57:19.409866 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-d6918323-d026-4789-992d-d05d02fc2a84 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d/os-volume_attachments/453aa64e-9de7-464f-8c8e-6870c2488c57" status: 404 len: 154 microversion: 2.1 time: 0.097754 Jun 17 08:57:19.409866 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 390/773] 10.222.0.78 () {58 vars in 1415 bytes} [Fri Jun 17 08:57:19 2022] DELETE /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d/os-volume_attachments/453aa64e-9de7-464f-8c8e-6870c2488c57 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:57:20.315857 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-6ec8e530-9c19-4ed6-9f0f-26001a64469d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:20.316452 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-6ec8e530-9c19-4ed6-9f0f-26001a64469d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:20.323088 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6ec8e530-9c19-4ed6-9f0f-26001a64469d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:20.323572 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6ec8e530-9c19-4ed6-9f0f-26001a64469d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:20.324344 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6ec8e530-9c19-4ed6-9f0f-26001a64469d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:20.324781 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6ec8e530-9c19-4ed6-9f0f-26001a64469d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:20.461049 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-6ec8e530-9c19-4ed6-9f0f-26001a64469d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:20.468985 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-6ec8e530-9c19-4ed6-9f0f-26001a64469d tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1735 microversion: 2.1 time: 0.157080 Jun 17 08:57:20.469555 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 384/774] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:20 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:20.653002 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-c7908ead-6ff7-43c1-937b-a2bdb6bf8dfe tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:20.653516 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-c7908ead-6ff7-43c1-937b-a2bdb6bf8dfe tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:20.660951 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c7908ead-6ff7-43c1-937b-a2bdb6bf8dfe tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:20.661396 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c7908ead-6ff7-43c1-937b-a2bdb6bf8dfe tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:20.662183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c7908ead-6ff7-43c1-937b-a2bdb6bf8dfe tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:20.662657 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c7908ead-6ff7-43c1-937b-a2bdb6bf8dfe tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:20.687904 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-c7908ead-6ff7-43c1-937b-a2bdb6bf8dfe tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Going to try to terminate instance {{(pid=129876) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:57:20.701916 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:20.957149 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-c7908ead-6ff7-43c1-937b-a2bdb6bf8dfe tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 204 len: 0 microversion: 2.1 time: 0.307741 Jun 17 08:57:20.957650 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 391/775] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 08:57:20 2022] DELETE /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:57:20.966022 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3b5d6f10-1163-42ef-9988-a54f36971fca tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:20.966632 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-3b5d6f10-1163-42ef-9988-a54f36971fca tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:20.972689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3b5d6f10-1163-42ef-9988-a54f36971fca tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:20.973132 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3b5d6f10-1163-42ef-9988-a54f36971fca tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:20.973893 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3b5d6f10-1163-42ef-9988-a54f36971fca tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:20.974326 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3b5d6f10-1163-42ef-9988-a54f36971fca tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:21.107988 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3b5d6f10-1163-42ef-9988-a54f36971fca tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:21.115516 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-3b5d6f10-1163-42ef-9988-a54f36971fca tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1554 microversion: 2.1 time: 0.153255 Jun 17 08:57:21.116085 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 385/776] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:20 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:21.144379 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-ee650971-6d77-45fd-b472-2f39086b7110 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:21.145041 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-ee650971-6d77-45fd-b472-2f39086b7110 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:21.151538 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ee650971-6d77-45fd-b472-2f39086b7110 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:21.152067 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ee650971-6d77-45fd-b472-2f39086b7110 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:21.152890 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ee650971-6d77-45fd-b472-2f39086b7110 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:21.153348 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ee650971-6d77-45fd-b472-2f39086b7110 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:21.177017 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-ee650971-6d77-45fd-b472-2f39086b7110 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964/ips" status: 200 len: 149 microversion: 2.1 time: 0.158046 Jun 17 08:57:21.177568 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 392/777] 10.222.0.78 () {58 vars in 1247 bytes} [Fri Jun 17 08:57:21 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964/ips => generated 149 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:57:21.486081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a08010d4-4f29-4267-b4b9-ddc0d7f18570 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:21.497054 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-a08010d4-4f29-4267-b4b9-ddc0d7f18570 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:21.497054 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a08010d4-4f29-4267-b4b9-ddc0d7f18570 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:21.497054 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a08010d4-4f29-4267-b4b9-ddc0d7f18570 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:21.497054 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a08010d4-4f29-4267-b4b9-ddc0d7f18570 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:21.497427 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a08010d4-4f29-4267-b4b9-ddc0d7f18570 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:21.641388 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a08010d4-4f29-4267-b4b9-ddc0d7f18570 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:21.649742 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-a08010d4-4f29-4267-b4b9-ddc0d7f18570 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1735 microversion: 2.1 time: 0.167624 Jun 17 08:57:21.652284 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 386/778] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:21 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:22.133896 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-859d527c-cd51-41c3-b199-9ca0c9349e5c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:22.134442 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-859d527c-cd51-41c3-b199-9ca0c9349e5c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:22.141518 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-859d527c-cd51-41c3-b199-9ca0c9349e5c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:22.142093 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-859d527c-cd51-41c3-b199-9ca0c9349e5c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:22.142900 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-859d527c-cd51-41c3-b199-9ca0c9349e5c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:22.143857 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-859d527c-cd51-41c3-b199-9ca0c9349e5c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:22.282591 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-859d527c-cd51-41c3-b199-9ca0c9349e5c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:22.290998 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-859d527c-cd51-41c3-b199-9ca0c9349e5c tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1554 microversion: 2.1 time: 0.161240 Jun 17 08:57:22.295699 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 393/779] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:22 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:22.667730 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-8807692c-756b-4df5-acc5-cb707de26b35 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:22.668449 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-8807692c-756b-4df5-acc5-cb707de26b35 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:22.674854 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8807692c-756b-4df5-acc5-cb707de26b35 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:22.675300 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8807692c-756b-4df5-acc5-cb707de26b35 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:22.676097 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8807692c-756b-4df5-acc5-cb707de26b35 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:22.676547 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8807692c-756b-4df5-acc5-cb707de26b35 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:22.777000 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-66ae5b55-aee4-441b-96e7-b9a901ec8c13 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7a9ca9e-96e1-4499-b1a4-6ab281274871"}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:57:22.778129 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-66ae5b55-aee4-441b-96e7-b9a901ec8c13 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:22.784785 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-66ae5b55-aee4-441b-96e7-b9a901ec8c13 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:22.785242 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-66ae5b55-aee4-441b-96e7-b9a901ec8c13 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:22.786113 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-66ae5b55-aee4-441b-96e7-b9a901ec8c13 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:22.786638 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-66ae5b55-aee4-441b-96e7-b9a901ec8c13 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:22.814203 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-8807692c-756b-4df5-acc5-cb707de26b35 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:22.824178 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-8807692c-756b-4df5-acc5-cb707de26b35 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1735 microversion: 2.1 time: 0.160309 Jun 17 08:57:22.824830 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 387/780] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:22 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:23.308746 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-c6a88116-82ef-4974-99b3-e424dadc83f8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:23.309363 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-c6a88116-82ef-4974-99b3-e424dadc83f8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:23.315444 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c6a88116-82ef-4974-99b3-e424dadc83f8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:23.315898 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c6a88116-82ef-4974-99b3-e424dadc83f8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:23.316662 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c6a88116-82ef-4974-99b3-e424dadc83f8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:23.317095 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c6a88116-82ef-4974-99b3-e424dadc83f8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:23.488501 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c6a88116-82ef-4974-99b3-e424dadc83f8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:23.496922 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-c6a88116-82ef-4974-99b3-e424dadc83f8 tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1554 microversion: 2.1 time: 0.192102 Jun 17 08:57:23.497574 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 388/781] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:23 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1554 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:57:23.842597 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-8d6dd788-b74b-4129-9a35-aeb3fac7fbd3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:23.843242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-8d6dd788-b74b-4129-9a35-aeb3fac7fbd3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:23.850255 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8d6dd788-b74b-4129-9a35-aeb3fac7fbd3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:23.850773 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8d6dd788-b74b-4129-9a35-aeb3fac7fbd3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:23.851536 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8d6dd788-b74b-4129-9a35-aeb3fac7fbd3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:23.851974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8d6dd788-b74b-4129-9a35-aeb3fac7fbd3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:24.056018 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-8d6dd788-b74b-4129-9a35-aeb3fac7fbd3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:24.066201 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-8d6dd788-b74b-4129-9a35-aeb3fac7fbd3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1735 microversion: 2.1 time: 0.226357 Jun 17 08:57:24.066882 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 389/782] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:23 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1735 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:57:24.492682 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-66ae5b55-aee4-441b-96e7-b9a901ec8c13 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "POST /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.719442 Jun 17 08:57:24.493541 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 394/783] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jun 17 08:57:22 2022] POST /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964/os-volume_attachments => generated 194 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:57:24.510905 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-0da0aabf-364e-4eaa-8b2c-9c6ab24b1910 req-eccfaf95-a339-4347-b7d2-1d985c21d15f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e254b695-5369-48d6-9966-64f25873dc0d", "name": "network-vif-deleted", "tag": "5a6e2dcc-1d88-4ebd-8cce-063737a7db08"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:57:24.519286 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-0da0aabf-364e-4eaa-8b2c-9c6ab24b1910 req-eccfaf95-a339-4347-b7d2-1d985c21d15f service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:24.519839 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-0da0aabf-364e-4eaa-8b2c-9c6ab24b1910 req-eccfaf95-a339-4347-b7d2-1d985c21d15f service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:24.524587 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-46eb7cb7-c246-4918-9e88-57b6282a63ec tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:24.525546 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-46eb7cb7-c246-4918-9e88-57b6282a63ec tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:24.532170 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-46eb7cb7-c246-4918-9e88-57b6282a63ec tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:24.532469 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-0da0aabf-364e-4eaa-8b2c-9c6ab24b1910 req-eccfaf95-a339-4347-b7d2-1d985c21d15f service nova] Creating event network-vif-deleted:5a6e2dcc-1d88-4ebd-8cce-063737a7db08 for instance e254b695-5369-48d6-9966-64f25873dc0d on hv-cinder-79760 Jun 17 08:57:24.532613 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-46eb7cb7-c246-4918-9e88-57b6282a63ec tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:24.533385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-46eb7cb7-c246-4918-9e88-57b6282a63ec tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:24.533850 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-46eb7cb7-c246-4918-9e88-57b6282a63ec tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:24.538801 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-0da0aabf-364e-4eaa-8b2c-9c6ab24b1910 req-eccfaf95-a339-4347-b7d2-1d985c21d15f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031307 Jun 17 08:57:24.539803 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 390/784] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:57:24.619035 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-46eb7cb7-c246-4918-9e88-57b6282a63ec tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:24.627243 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-46eb7cb7-c246-4918-9e88-57b6282a63ec tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1512 microversion: 2.1 time: 0.115837 Jun 17 08:57:24.628981 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 395/785] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:24 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1512 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:25.085646 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-7d98a632-7864-45f8-9328-20bdad51c26c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:25.086246 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-7d98a632-7864-45f8-9328-20bdad51c26c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:25.092754 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7d98a632-7864-45f8-9328-20bdad51c26c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:25.093203 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7d98a632-7864-45f8-9328-20bdad51c26c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:25.093961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7d98a632-7864-45f8-9328-20bdad51c26c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:25.094394 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7d98a632-7864-45f8-9328-20bdad51c26c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:25.239591 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-7d98a632-7864-45f8-9328-20bdad51c26c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:25.248317 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-7d98a632-7864-45f8-9328-20bdad51c26c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1735 microversion: 2.1 time: 0.168294 Jun 17 08:57:25.248885 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 391/786] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:25 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:25.646654 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-52aa34e5-5e10-4477-a2ca-8ea324f0606a tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:25.647377 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-52aa34e5-5e10-4477-a2ca-8ea324f0606a tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:25.649917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:25.654925 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-52aa34e5-5e10-4477-a2ca-8ea324f0606a tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:25.655445 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-52aa34e5-5e10-4477-a2ca-8ea324f0606a tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:25.656292 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-52aa34e5-5e10-4477-a2ca-8ea324f0606a tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:25.656785 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-52aa34e5-5e10-4477-a2ca-8ea324f0606a tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:25.689253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-52aa34e5-5e10-4477-a2ca-8ea324f0606a tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:25.689771 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-52aa34e5-5e10-4477-a2ca-8ea324f0606a tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:25.690792 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.objects.instance [None req-52aa34e5-5e10-4477-a2ca-8ea324f0606a tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lazy-loading 'fault' on Instance uuid e254b695-5369-48d6-9966-64f25873dc0d {{(pid=129876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:57:25.731073 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-52aa34e5-5e10-4477-a2ca-8ea324f0606a tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ab8c84c68b4275b2f81b69d8a52826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a0a44acc444e8eb9bba54a8e089f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:25.739092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-52aa34e5-5e10-4477-a2ca-8ea324f0606a tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 200 len: 1349 microversion: 2.1 time: 0.097471 Jun 17 08:57:25.739739 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 396/787] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:25 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:26.266095 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-15ea5c01-0605-4a4d-9900-0d264eb97c88 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:26.266742 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-15ea5c01-0605-4a4d-9900-0d264eb97c88 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:26.273884 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-15ea5c01-0605-4a4d-9900-0d264eb97c88 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:26.274327 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-15ea5c01-0605-4a4d-9900-0d264eb97c88 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:26.275107 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-15ea5c01-0605-4a4d-9900-0d264eb97c88 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:26.275587 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-15ea5c01-0605-4a4d-9900-0d264eb97c88 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:26.410551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-15ea5c01-0605-4a4d-9900-0d264eb97c88 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:26.418636 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-15ea5c01-0605-4a4d-9900-0d264eb97c88 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1715 microversion: 2.1 time: 0.156507 Jun 17 08:57:26.419197 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 392/788] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:26 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1715 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:26.525296 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-caf48e2f-9468-4424-a662-4c1df0c40aec tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:26.525724 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-caf48e2f-9468-4424-a662-4c1df0c40aec tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:26.531712 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-caf48e2f-9468-4424-a662-4c1df0c40aec tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:26.532164 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-caf48e2f-9468-4424-a662-4c1df0c40aec tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:26.532938 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-caf48e2f-9468-4424-a662-4c1df0c40aec tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:26.533378 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-caf48e2f-9468-4424-a662-4c1df0c40aec tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:26.618795 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-caf48e2f-9468-4424-a662-4c1df0c40aec tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] HTTP exception thrown: Cannot 'detach_volume' instance 1eb89053-6d2e-47f4-a675-6254d182e074 while it is in vm_state rescued Jun 17 08:57:26.620419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-caf48e2f-9468-4424-a662-4c1df0c40aec tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Request method failure captured: Jun 17 08:57:26.620419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: DELETE /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074/os-volume_attachments/a40ed135-1a4e-456d-a5dd-1ce31dee8d66 HTTP/1.1 Jun 17 08:57:26.620419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:57:26.620419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:57:26.620419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:57:26.620419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 08:57:26.620419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:57:26.620419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:57:26.620419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:57:26.620419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:57:26.620419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirED5Euje8Qg466HZfzI6zCL6KuGF5BH7fLi2Pmi8ij3gYtPI6C-73btuLA8X2nSXoPf1noq4TUDtlOwCduBS9xL7_px9uXygULPkVYrbJQFD3qLcxvxV0BbEkrPf4s4e0iVeOxxYopv4Knn2YUw0jM9QPTqum78gRvcAfDjXtIdH9hY Jun 17 08:57:26.620419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:57:26.620419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:57:26.620419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:57:26.620419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:57:26.620419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:57:26.620419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:57:26.620419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: 6cd5b6aa6edd4bafa8aec3e9d28ae980 Jun 17 08:57:26.620419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1528519624 Jun 17 08:57:26.620419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:57:26.620419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:57:26.621929 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6cd5b6aa6edd4bafa8aec3e9d28ae980"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6cd5b6aa6edd4bafa8aec3e9d28ae980"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6cd5b6aa6edd4bafa8aec3e9d28ae980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6cd5b6aa6edd4bafa8aec3e9d28ae980"}]}] Jun 17 08:57:26.621929 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1528519624 Jun 17 08:57:26.621929 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: 6cd5b6aa6edd4bafa8aec3e9d28ae980 Jun 17 08:57:26.621929 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1528519624 Jun 17 08:57:26.621929 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-ServerRescueNegativeTestJSON-1528519624-project Jun 17 08:57:26.621929 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:57:26.621929 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:57:26.621929 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: 5e4214dbd10d491eb6afa50321edca88 Jun 17 08:57:26.621929 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1528519624-project Jun 17 08:57:26.621929 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 08:57:26.621929 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Cannot 'detach_volume' instance 1eb89053-6d2e-47f4-a675-6254d182e074 while it is in vm_state rescued Jun 17 08:57:26.622750 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'server_id': '1eb89053-6d2e-47f4-a675-6254d182e074', 'id': 'a40ed135-1a4e-456d-a5dd-1ce31dee8d66'} Jun 17 08:57:26.622750 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:57:26.622750 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:57:26.622750 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 08:57:26.622750 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 08:57:26.622750 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 08:57:26.622750 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 08:57:26.622750 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 17 08:57:26.622750 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 17 08:57:26.622750 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1eb89053-6d2e-47f4-a675-6254d182e074 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 17 08:57:26.622750 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:57:26.622750 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:57:26.622750 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:57:26.622750 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:57:26.622750 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:57:26.622750 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:57:26.622750 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:57:26.622750 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:57:26.622750 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:57:26.622750 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:57:26.624183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 17 08:57:26.624183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 17 08:57:26.624183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 17 08:57:26.624183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 17 08:57:26.624183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1eb89053-6d2e-47f4-a675-6254d182e074 while it is in vm_state rescued Jun 17 08:57:26.624183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:57:26.624183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:57:26.624183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:57:26.624183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:57:26.624183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:57:26.624183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:57:26.624183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:57:26.624183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:57:26.624183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1eb89053-6d2e-47f4-a675-6254d182e074 while it is in vm_state rescued Jun 17 08:57:26.624183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:57:26.624183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-caf48e2f-9468-4424-a662-4c1df0c40aec tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Returning 409 to user: Cannot 'detach_volume' instance 1eb89053-6d2e-47f4-a675-6254d182e074 while it is in vm_state rescued {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:57:26.625344 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-caf48e2f-9468-4424-a662-4c1df0c40aec tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074/os-volume_attachments/a40ed135-1a4e-456d-a5dd-1ce31dee8d66" status: 409 len: 152 microversion: 2.1 time: 0.100599 Jun 17 08:57:26.625344 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 397/789] 10.222.0.78 () {58 vars in 1415 bytes} [Fri Jun 17 08:57:26 2022] DELETE /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074/os-volume_attachments/a40ed135-1a4e-456d-a5dd-1ce31dee8d66 => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 17 08:57:26.631798 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-17928738-fbd2-4c37-8cb6-dc955cdfee19 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:57:26.632382 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-17928738-fbd2-4c37-8cb6-dc955cdfee19 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:26.638734 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-17928738-fbd2-4c37-8cb6-dc955cdfee19 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:26.639207 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-17928738-fbd2-4c37-8cb6-dc955cdfee19 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:26.640046 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-17928738-fbd2-4c37-8cb6-dc955cdfee19 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:26.640530 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-17928738-fbd2-4c37-8cb6-dc955cdfee19 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:26.755522 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-c0fda14a-8df3-41da-b884-e58d24a58f4f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:26.756327 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-c0fda14a-8df3-41da-b884-e58d24a58f4f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] [instance: e254b695-5369-48d6-9966-64f25873dc0d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:26.762975 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c0fda14a-8df3-41da-b884-e58d24a58f4f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:26.763453 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c0fda14a-8df3-41da-b884-e58d24a58f4f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:26.764215 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c0fda14a-8df3-41da-b884-e58d24a58f4f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:26.764648 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c0fda14a-8df3-41da-b884-e58d24a58f4f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:26.778896 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-c0fda14a-8df3-41da-b884-e58d24a58f4f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] HTTP exception thrown: Instance e254b695-5369-48d6-9966-64f25873dc0d could not be found. Jun 17 08:57:26.780415 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-c0fda14a-8df3-41da-b884-e58d24a58f4f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Request method failure captured: Jun 17 08:57:26.780415 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d HTTP/1.1 Jun 17 08:57:26.780415 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:57:26.780415 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:57:26.780415 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:57:26.780415 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 08:57:26.780415 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:57:26.780415 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:57:26.780415 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:57:26.780415 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:57:26.780415 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirEESjVMoWJpfwBg3ytQthC9tOn9nSPCtMw1EErUPzePdh_f_-vuL1ldQKHq7qy_HbWla5OsAgUuVBXydC9okxKcegfrcR9aqGOw1OB87_BFExZbI9lq5vYSY-8h_MMfr5S75B7XUtV02Q2zJx9IpZzS8dzscvTYZ_HSQsDOXnyVmQJw Jun 17 08:57:26.780415 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:57:26.780415 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:57:26.780415 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:57:26.780415 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:57:26.780415 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:57:26.780415 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:57:26.780415 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: 45a0a44acc444e8eb9bba54a8e089f17 Jun 17 08:57:26.780415 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-TestMinimumBasicScenario-1343982915 Jun 17 08:57:26.780415 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:57:26.780415 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:57:26.781945 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/45a0a44acc444e8eb9bba54a8e089f17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/45a0a44acc444e8eb9bba54a8e089f17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_45a0a44acc444e8eb9bba54a8e089f17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/45a0a44acc444e8eb9bba54a8e089f17"}]}] Jun 17 08:57:26.781945 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-TestMinimumBasicScenario-1343982915 Jun 17 08:57:26.781945 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: 45a0a44acc444e8eb9bba54a8e089f17 Jun 17 08:57:26.781945 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1343982915 Jun 17 08:57:26.781945 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-TestMinimumBasicScenario-1343982915-project Jun 17 08:57:26.781945 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:57:26.781945 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:57:26.781945 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: b9ab8c84c68b4275b2f81b69d8a52826 Jun 17 08:57:26.781945 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-TestMinimumBasicScenario-1343982915-project Jun 17 08:57:26.781945 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 08:57:26.781945 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Instance e254b695-5369-48d6-9966-64f25873dc0d could not be found. Jun 17 08:57:26.781945 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'id': 'e254b695-5369-48d6-9966-64f25873dc0d'} Jun 17 08:57:26.782853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:57:26.782853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:57:26.782853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:57:26.782853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:57:26.782853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:57:26.782853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:57:26.782853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:57:26.782853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:57:26.782853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:57:26.782853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:57:26.782853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e254b695-5369-48d6-9966-64f25873dc0d could not be found. Jun 17 08:57:26.782853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:57:26.782853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:57:26.782853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:57:26.782853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:57:26.782853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:57:26.782853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:57:26.782853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:57:26.782853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:57:26.782853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:57:26.784758 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:57:26.784758 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:57:26.784758 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:57:26.784758 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:57:26.784758 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:57:26.784758 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:57:26.784758 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:57:26.784758 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e254b695-5369-48d6-9966-64f25873dc0d could not be found. Jun 17 08:57:26.784758 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:57:26.784758 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:57:26.784758 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:57:26.784758 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:57:26.784758 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:57:26.784758 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:57:26.784758 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:57:26.784758 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:57:26.784758 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e254b695-5369-48d6-9966-64f25873dc0d could not be found. Jun 17 08:57:26.784758 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:57:26.786018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-c0fda14a-8df3-41da-b884-e58d24a58f4f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Returning 404 to user: Instance e254b695-5369-48d6-9966-64f25873dc0d could not be found. {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:57:26.786018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-c0fda14a-8df3-41da-b884-e58d24a58f4f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d" status: 404 len: 111 microversion: 2.1 time: 0.030355 Jun 17 08:57:26.786018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 398/790] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:26 2022] GET /compute/v2.1/servers/e254b695-5369-48d6-9966-64f25873dc0d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 08:57:26.791697 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e2e8f124-9fff-4a0d-946f-21eb5594705f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] Calling method '.version_select at 0x7fbc443c6af0>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:26.835145 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-17928738-fbd2-4c37-8cb6-dc955cdfee19 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "POST /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074/action" status: 202 len: 0 microversion: 2.1 time: 0.207416 Jun 17 08:57:26.835964 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 393/791] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jun 17 08:57:26 2022] POST /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:57:26.844874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0784f753-7851-45ec-b388-ffa52c2252e2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:26.845649 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0784f753-7851-45ec-b388-ffa52c2252e2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:26.852639 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0784f753-7851-45ec-b388-ffa52c2252e2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:26.853088 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0784f753-7851-45ec-b388-ffa52c2252e2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:26.853995 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0784f753-7851-45ec-b388-ffa52c2252e2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:26.854443 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0784f753-7851-45ec-b388-ffa52c2252e2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:26.855215 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-e2e8f124-9fff-4a0d-946f-21eb5594705f tempest-TestMinimumBasicScenario-1343982915 tempest-TestMinimumBasicScenario-1343982915-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1430171894" status: 202 len: 0 microversion: 2.1 time: 0.067004 Jun 17 08:57:26.859338 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 399/792] 10.222.0.78 () {58 vars in 1271 bytes} [Fri Jun 17 08:57:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1430171894 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 08:57:27.069787 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0784f753-7851-45ec-b388-ffa52c2252e2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:27.072204 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:27.078926 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0784f753-7851-45ec-b388-ffa52c2252e2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1723 microversion: 2.1 time: 0.238508 Jun 17 08:57:27.079968 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 394/793] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:26 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:57:28.099143 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-50dbafcf-e256-4ee4-a3fc-1acdf633e837 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:28.100096 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-50dbafcf-e256-4ee4-a3fc-1acdf633e837 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:28.107002 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-50dbafcf-e256-4ee4-a3fc-1acdf633e837 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:28.107528 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-50dbafcf-e256-4ee4-a3fc-1acdf633e837 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:28.108294 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-50dbafcf-e256-4ee4-a3fc-1acdf633e837 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:28.108731 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-50dbafcf-e256-4ee4-a3fc-1acdf633e837 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:28.245754 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-50dbafcf-e256-4ee4-a3fc-1acdf633e837 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:28.254010 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-50dbafcf-e256-4ee4-a3fc-1acdf633e837 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1723 microversion: 2.1 time: 0.160613 Jun 17 08:57:28.254574 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 400/794] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:28 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:29.271690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-383439f2-3778-4dce-88e0-03b819ab826a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:29.272293 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-383439f2-3778-4dce-88e0-03b819ab826a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:29.279579 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-383439f2-3778-4dce-88e0-03b819ab826a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:29.280030 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-383439f2-3778-4dce-88e0-03b819ab826a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:29.281762 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-383439f2-3778-4dce-88e0-03b819ab826a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:29.281762 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-383439f2-3778-4dce-88e0-03b819ab826a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:29.547264 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-383439f2-3778-4dce-88e0-03b819ab826a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:29.556502 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-383439f2-3778-4dce-88e0-03b819ab826a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1723 microversion: 2.1 time: 0.288903 Jun 17 08:57:29.557376 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 395/795] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:29 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:30.574651 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-0cb60d17-9172-42af-af46-bb994c0eef00 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:30.575554 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-0cb60d17-9172-42af-af46-bb994c0eef00 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:30.583607 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0cb60d17-9172-42af-af46-bb994c0eef00 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:30.584133 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0cb60d17-9172-42af-af46-bb994c0eef00 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:30.585001 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0cb60d17-9172-42af-af46-bb994c0eef00 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:30.585514 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0cb60d17-9172-42af-af46-bb994c0eef00 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:31.148130 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-0cb60d17-9172-42af-af46-bb994c0eef00 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:31.156852 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-0cb60d17-9172-42af-af46-bb994c0eef00 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1729 microversion: 2.1 time: 0.586554 Jun 17 08:57:31.157428 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 401/796] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:30 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1729 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:31.176196 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-239730f7-9f02-4a98-ab88-5cff304302e2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:31.176749 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-239730f7-9f02-4a98-ab88-5cff304302e2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:31.184671 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-239730f7-9f02-4a98-ab88-5cff304302e2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:31.185225 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-239730f7-9f02-4a98-ab88-5cff304302e2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:31.186111 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-239730f7-9f02-4a98-ab88-5cff304302e2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:31.186626 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-239730f7-9f02-4a98-ab88-5cff304302e2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:31.274943 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-239730f7-9f02-4a98-ab88-5cff304302e2 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103181 Jun 17 08:57:31.275928 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 396/797] 10.222.0.78 () {58 vars in 1274 bytes} [Fri Jun 17 08:57:31 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:57:32.123020 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-ee246804-6f15-4631-8505-b194148f9af2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7a9ca9e-96e1-4499-b1a4-6ab281274871"}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:57:32.124174 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-ee246804-6f15-4631-8505-b194148f9af2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:32.139581 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ee246804-6f15-4631-8505-b194148f9af2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:32.140077 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ee246804-6f15-4631-8505-b194148f9af2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:32.141097 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ee246804-6f15-4631-8505-b194148f9af2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:32.141772 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ee246804-6f15-4631-8505-b194148f9af2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:32.252125 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-ee246804-6f15-4631-8505-b194148f9af2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] HTTP exception thrown: Invalid volume: volume c7a9ca9e-96e1-4499-b1a4-6ab281274871 is already attached to instances: fab8f2eb-71c8-4956-b693-06f73bf86964 Jun 17 08:57:32.254608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-ee246804-6f15-4631-8505-b194148f9af2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Request method failure captured: Jun 17 08:57:32.254608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: POST /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964/os-volume_attachments HTTP/1.1 Jun 17 08:57:32.254608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:57:32.254608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:57:32.254608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:57:32.254608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 74 Jun 17 08:57:32.254608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:57:32.254608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:57:32.254608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:57:32.254608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:57:32.254608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirECoefK_2BxjZgVOeODeD0JulOcw4b3dCrWlpFY_cQoAEUxcK30AdtBELaLH-kVfcQ6VKJx7aLTz7Z0L639CzJLSrkIUHMaE3fnQwSThKfCgM9dozYdAIITDcNAYtXkDc4HYT-B7uJX_QV7RNcl_PdXigEFPXJ9IRk3STBItMRTcdRI Jun 17 08:57:32.254608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:57:32.254608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:57:32.254608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:57:32.254608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:57:32.254608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:57:32.254608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:57:32.254608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:57:32.254608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:57:32.254608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:57:32.254608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:57:32.255973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}] Jun 17 08:57:32.255973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:57:32.255973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:57:32.255973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:57:32.255973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:57:32.255973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:57:32.255973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:57:32.255973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: 01bb3df8b4b649388d1a0f6c24e18f1b Jun 17 08:57:32.255973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:57:32.255973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Jun 17 08:57:32.255973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {"volumeAttachment": {"volumeId": "c7a9ca9e-96e1-4499-b1a4-6ab281274871"}} Jun 17 08:57:32.255973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 08:57:32.256730 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Invalid volume: volume c7a9ca9e-96e1-4499-b1a4-6ab281274871 is already attached to instances: fab8f2eb-71c8-4956-b693-06f73bf86964 Jun 17 08:57:32.256730 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'server_id': 'fab8f2eb-71c8-4956-b693-06f73bf86964', 'body': {'volumeAttachment': {'volumeId': 'c7a9ca9e-96e1-4499-b1a4-6ab281274871'}}} Jun 17 08:57:32.256730 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:57:32.256730 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:57:32.256730 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 17 08:57:32.256730 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 17 08:57:32.256730 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 08:57:32.256730 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 08:57:32.256730 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 08:57:32.256730 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 08:57:32.256730 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 17 08:57:32.256730 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 17 08:57:32.256730 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 17 08:57:32.256730 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 17 08:57:32.256730 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c7a9ca9e-96e1-4499-b1a4-6ab281274871 is already attached to instances: fab8f2eb-71c8-4956-b693-06f73bf86964 Jun 17 08:57:32.256730 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:57:32.256730 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:57:32.256730 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:57:32.256730 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:57:32.257965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:57:32.257965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:57:32.257965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:57:32.257965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:57:32.257965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:57:32.257965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:57:32.257965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 08:57:32.257965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 08:57:32.257965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 08:57:32.257965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 08:57:32.257965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 08:57:32.257965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 08:57:32.257965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 17 08:57:32.257965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 08:57:32.257965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c7a9ca9e-96e1-4499-b1a4-6ab281274871 is already attached to instances: fab8f2eb-71c8-4956-b693-06f73bf86964 Jun 17 08:57:32.257965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:57:32.257965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:57:32.257965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:57:32.257965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:57:32.257965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:57:32.259137 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:57:32.259137 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:57:32.259137 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:57:32.259137 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c7a9ca9e-96e1-4499-b1a4-6ab281274871 is already attached to instances: fab8f2eb-71c8-4956-b693-06f73bf86964 Jun 17 08:57:32.259137 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:57:32.261425 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-ee246804-6f15-4631-8505-b194148f9af2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Returning 400 to user: Invalid volume: volume c7a9ca9e-96e1-4499-b1a4-6ab281274871 is already attached to instances: fab8f2eb-71c8-4956-b693-06f73bf86964 {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:57:32.262554 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-ee246804-6f15-4631-8505-b194148f9af2 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "POST /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.144109 Jun 17 08:57:32.266908 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 402/798] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jun 17 08:57:32 2022] POST /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964/os-volume_attachments => generated 174 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 08:57:32.349524 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-5fd6be67-eb3c-45b1-87ce-c95647103cf7 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:32.350706 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-5fd6be67-eb3c-45b1-87ce-c95647103cf7 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:32.358443 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5fd6be67-eb3c-45b1-87ce-c95647103cf7 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:32.359211 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5fd6be67-eb3c-45b1-87ce-c95647103cf7 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:32.360210 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5fd6be67-eb3c-45b1-87ce-c95647103cf7 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:32.360838 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5fd6be67-eb3c-45b1-87ce-c95647103cf7 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:32.497188 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-5fd6be67-eb3c-45b1-87ce-c95647103cf7 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lazy-loading 'services' on Instance uuid fab8f2eb-71c8-4956-b693-06f73bf86964 {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:57:32.505452 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-ec7b02ce-b64d-4d41-89e4-91f78c0f7e02 req-f97898be-f7b9-4730-952a-4eaf3910d5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eb89053-6d2e-47f4-a675-6254d182e074", "tag": "b987fec9-a409-4d3b-a983-64e04e498d92"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:57:32.515891 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-ec7b02ce-b64d-4d41-89e4-91f78c0f7e02 req-f97898be-f7b9-4730-952a-4eaf3910d5d4 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:32.516338 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-ec7b02ce-b64d-4d41-89e4-91f78c0f7e02 req-f97898be-f7b9-4730-952a-4eaf3910d5d4 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:32.529250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-ec7b02ce-b64d-4d41-89e4-91f78c0f7e02 req-f97898be-f7b9-4730-952a-4eaf3910d5d4 service nova] Creating event network-changed:b987fec9-a409-4d3b-a983-64e04e498d92 for instance 1eb89053-6d2e-47f4-a675-6254d182e074 on hv-cinder-79760 Jun 17 08:57:32.535147 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-ec7b02ce-b64d-4d41-89e4-91f78c0f7e02 req-f97898be-f7b9-4730-952a-4eaf3910d5d4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033532 Jun 17 08:57:32.539410 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 403/799] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:57:32.832119 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-5fd6be67-eb3c-45b1-87ce-c95647103cf7 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964/os-volume_attachments/c7a9ca9e-96e1-4499-b1a4-6ab281274871" status: 202 len: 0 microversion: 2.1 time: 0.486012 Jun 17 08:57:32.844755 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-3a83c85f-6ab8-462a-8ca4-664bd54d6a30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:32.844755 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-3a83c85f-6ab8-462a-8ca4-664bd54d6a30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:32.848854 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 397/800] 10.222.0.78 () {58 vars in 1415 bytes} [Fri Jun 17 08:57:32 2022] DELETE /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964/os-volume_attachments/c7a9ca9e-96e1-4499-b1a4-6ab281274871 => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:57:32.853024 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3a83c85f-6ab8-462a-8ca4-664bd54d6a30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:32.853727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3a83c85f-6ab8-462a-8ca4-664bd54d6a30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:32.855003 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3a83c85f-6ab8-462a-8ca4-664bd54d6a30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:32.855858 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3a83c85f-6ab8-462a-8ca4-664bd54d6a30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:32.895450 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-3a83c85f-6ab8-462a-8ca4-664bd54d6a30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057306 Jun 17 08:57:32.896281 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 404/801] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 08:57:32 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:57:33.449412 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-b43dbac2-2ca8-48ed-adaf-2bb72f44abb5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:57:33.450821 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-b43dbac2-2ca8-48ed-adaf-2bb72f44abb5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:33.458673 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b43dbac2-2ca8-48ed-adaf-2bb72f44abb5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:33.459405 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b43dbac2-2ca8-48ed-adaf-2bb72f44abb5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:33.460350 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b43dbac2-2ca8-48ed-adaf-2bb72f44abb5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:33.460931 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b43dbac2-2ca8-48ed-adaf-2bb72f44abb5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:33.492112 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-b43dbac2-2ca8-48ed-adaf-2bb72f44abb5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lazy-loading 'flavor' on Instance uuid 8e32781c-7056-4c56-a02d-4c94cbc414f8 {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:57:33.820763 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-b43dbac2-2ca8-48ed-adaf-2bb72f44abb5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "POST /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8/action" status: 202 len: 0 microversion: 2.1 time: 0.376549 Jun 17 08:57:33.821864 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 398/802] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jun 17 08:57:33 2022] POST /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:57:33.830464 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-999e6390-d60b-4364-b711-59181c348c24 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:33.832062 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-999e6390-d60b-4364-b711-59181c348c24 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:33.839431 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-999e6390-d60b-4364-b711-59181c348c24 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:33.839881 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-999e6390-d60b-4364-b711-59181c348c24 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:33.840652 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-999e6390-d60b-4364-b711-59181c348c24 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:33.841087 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-999e6390-d60b-4364-b711-59181c348c24 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:33.909704 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-9337aab7-a5fb-4f51-81c6-647fbaf9899b tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:33.911247 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-9337aab7-a5fb-4f51-81c6-647fbaf9899b tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:33.928101 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9337aab7-a5fb-4f51-81c6-647fbaf9899b tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:33.928743 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9337aab7-a5fb-4f51-81c6-647fbaf9899b tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:33.940610 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9337aab7-a5fb-4f51-81c6-647fbaf9899b tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:33.941217 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9337aab7-a5fb-4f51-81c6-647fbaf9899b tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:33.976650 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-9337aab7-a5fb-4f51-81c6-647fbaf9899b tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072457 Jun 17 08:57:33.977560 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 399/803] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 08:57:33 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:57:34.043407 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-999e6390-d60b-4364-b711-59181c348c24 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:34.048433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-999e6390-d60b-4364-b711-59181c348c24 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1569 microversion: 2.1 time: 0.221748 Jun 17 08:57:34.049017 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 405/804] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:33 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1569 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:57:34.554812 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-ce5da2f1-b933-41bb-a20a-c9d67d36bde7 req-a6f5cfec-6410-4096-ad2a-dc696ae2f7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eb89053-6d2e-47f4-a675-6254d182e074", "tag": "b987fec9-a409-4d3b-a983-64e04e498d92"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:57:34.564067 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-ce5da2f1-b933-41bb-a20a-c9d67d36bde7 req-a6f5cfec-6410-4096-ad2a-dc696ae2f7f5 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:34.564607 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-ce5da2f1-b933-41bb-a20a-c9d67d36bde7 req-a6f5cfec-6410-4096-ad2a-dc696ae2f7f5 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:34.577705 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-ce5da2f1-b933-41bb-a20a-c9d67d36bde7 req-a6f5cfec-6410-4096-ad2a-dc696ae2f7f5 service nova] Creating event network-changed:b987fec9-a409-4d3b-a983-64e04e498d92 for instance 1eb89053-6d2e-47f4-a675-6254d182e074 on hv-cinder-79760 Jun 17 08:57:34.584212 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-ce5da2f1-b933-41bb-a20a-c9d67d36bde7 req-a6f5cfec-6410-4096-ad2a-dc696ae2f7f5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033282 Jun 17 08:57:34.588110 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 400/805] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:57:34.990819 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-f5fd6a80-370c-4a4a-9b16-94774ad37e8e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:34.992527 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-f5fd6a80-370c-4a4a-9b16-94774ad37e8e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:34.999519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f5fd6a80-370c-4a4a-9b16-94774ad37e8e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:35.000220 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f5fd6a80-370c-4a4a-9b16-94774ad37e8e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:35.000991 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f5fd6a80-370c-4a4a-9b16-94774ad37e8e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:35.001427 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f5fd6a80-370c-4a4a-9b16-94774ad37e8e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:35.043828 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-f5fd6a80-370c-4a4a-9b16-94774ad37e8e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057986 Jun 17 08:57:35.049617 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 406/806] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 08:57:34 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 08:57:35.067049 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-682ae04c-b675-4124-8201-25b4824d99fa tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:35.070307 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-682ae04c-b675-4124-8201-25b4824d99fa tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:35.075118 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-682ae04c-b675-4124-8201-25b4824d99fa tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:35.075867 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-682ae04c-b675-4124-8201-25b4824d99fa tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:35.077069 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-682ae04c-b675-4124-8201-25b4824d99fa tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:35.077721 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-682ae04c-b675-4124-8201-25b4824d99fa tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:35.118372 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-49150163-18e7-4802-bed1-6ff92d62e423 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:35.119205 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-49150163-18e7-4802-bed1-6ff92d62e423 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:35.125994 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-49150163-18e7-4802-bed1-6ff92d62e423 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:35.126654 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-49150163-18e7-4802-bed1-6ff92d62e423 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:35.127689 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-49150163-18e7-4802-bed1-6ff92d62e423 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:35.133447 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-49150163-18e7-4802-bed1-6ff92d62e423 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:35.168936 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-49150163-18e7-4802-bed1-6ff92d62e423 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Going to try to terminate instance {{(pid=129876) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:57:35.186028 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:35.279075 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-682ae04c-b675-4124-8201-25b4824d99fa tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:35.289288 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-682ae04c-b675-4124-8201-25b4824d99fa tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1569 microversion: 2.1 time: 0.226815 Jun 17 08:57:35.289903 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 401/807] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:35 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1569 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:35.511173 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-49150163-18e7-4802-bed1-6ff92d62e423 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964" status: 204 len: 0 microversion: 2.1 time: 0.397475 Jun 17 08:57:35.511925 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 407/808] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 08:57:35 2022] DELETE /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:57:35.522414 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-4f1a3556-fc41-4f12-851b-1f8befc88fce tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:35.523230 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-4f1a3556-fc41-4f12-851b-1f8befc88fce tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:35.529778 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4f1a3556-fc41-4f12-851b-1f8befc88fce tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:35.530316 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4f1a3556-fc41-4f12-851b-1f8befc88fce tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:35.531196 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4f1a3556-fc41-4f12-851b-1f8befc88fce tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:35.531766 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4f1a3556-fc41-4f12-851b-1f8befc88fce tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:35.741964 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-4f1a3556-fc41-4f12-851b-1f8befc88fce tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:35.750067 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-4f1a3556-fc41-4f12-851b-1f8befc88fce tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964" status: 200 len: 1680 microversion: 2.1 time: 0.233640 Jun 17 08:57:35.750648 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 402/809] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:35 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 => generated 1680 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:36.307186 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-175ad960-22f4-45c4-b559-79a5316722ca tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:36.308554 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-175ad960-22f4-45c4-b559-79a5316722ca tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:36.315678 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-175ad960-22f4-45c4-b559-79a5316722ca tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:36.316401 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-175ad960-22f4-45c4-b559-79a5316722ca tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:36.317191 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-175ad960-22f4-45c4-b559-79a5316722ca tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:36.317631 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-175ad960-22f4-45c4-b559-79a5316722ca tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:36.476455 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-175ad960-22f4-45c4-b559-79a5316722ca tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:36.493894 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-175ad960-22f4-45c4-b559-79a5316722ca tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1569 microversion: 2.1 time: 0.191068 Jun 17 08:57:36.494660 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 408/810] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:36 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:36.769459 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0cf94286-6a5f-4aa6-963c-0ff32fd7a12a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:36.769962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0cf94286-6a5f-4aa6-963c-0ff32fd7a12a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:36.777276 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0cf94286-6a5f-4aa6-963c-0ff32fd7a12a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:36.777938 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0cf94286-6a5f-4aa6-963c-0ff32fd7a12a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:36.778778 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0cf94286-6a5f-4aa6-963c-0ff32fd7a12a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:36.779615 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0cf94286-6a5f-4aa6-963c-0ff32fd7a12a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:36.917285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0cf94286-6a5f-4aa6-963c-0ff32fd7a12a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:36.925476 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0cf94286-6a5f-4aa6-963c-0ff32fd7a12a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964" status: 200 len: 1680 microversion: 2.1 time: 0.161421 Jun 17 08:57:36.935234 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 403/811] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:36 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:37.514103 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-074a65d6-6a7c-435d-8262-2772201f457e tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:37.514590 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-074a65d6-6a7c-435d-8262-2772201f457e tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:37.526582 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-074a65d6-6a7c-435d-8262-2772201f457e tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:37.527004 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-074a65d6-6a7c-435d-8262-2772201f457e tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:37.527823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-074a65d6-6a7c-435d-8262-2772201f457e tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:37.528273 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-074a65d6-6a7c-435d-8262-2772201f457e tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:37.765183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-074a65d6-6a7c-435d-8262-2772201f457e tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:37.773952 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-074a65d6-6a7c-435d-8262-2772201f457e tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1569 microversion: 2.1 time: 0.265408 Jun 17 08:57:37.774547 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 409/812] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:37 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1569 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:37.947112 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-e6e037f3-1a6d-4fda-a01c-9e4d59c02483 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:37.948533 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-e6e037f3-1a6d-4fda-a01c-9e4d59c02483 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:37.956427 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e6e037f3-1a6d-4fda-a01c-9e4d59c02483 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:37.956925 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e6e037f3-1a6d-4fda-a01c-9e4d59c02483 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:37.958073 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e6e037f3-1a6d-4fda-a01c-9e4d59c02483 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:37.958549 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e6e037f3-1a6d-4fda-a01c-9e4d59c02483 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:38.061219 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-e6e037f3-1a6d-4fda-a01c-9e4d59c02483 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:38.069505 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-e6e037f3-1a6d-4fda-a01c-9e4d59c02483 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964" status: 200 len: 1613 microversion: 2.1 time: 0.129323 Jun 17 08:57:38.070150 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 404/813] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:37 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 => generated 1613 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:38.280766 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-7b666171-491b-4354-840d-8d5a3c707412 req-19aa3ca2-5ae5-41ee-be74-c9ea2287c1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab8f2eb-71c8-4956-b693-06f73bf86964", "name": "network-vif-deleted", "tag": "115b315e-aa00-4ff6-9273-ebeabdd14b26"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:57:38.289970 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-7b666171-491b-4354-840d-8d5a3c707412 req-19aa3ca2-5ae5-41ee-be74-c9ea2287c1c6 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:38.290421 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-7b666171-491b-4354-840d-8d5a3c707412 req-19aa3ca2-5ae5-41ee-be74-c9ea2287c1c6 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:38.302099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-7b666171-491b-4354-840d-8d5a3c707412 req-19aa3ca2-5ae5-41ee-be74-c9ea2287c1c6 service nova] Creating event network-vif-deleted:115b315e-aa00-4ff6-9273-ebeabdd14b26 for instance fab8f2eb-71c8-4956-b693-06f73bf86964 on hv-cinder-79760 Jun 17 08:57:38.310854 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-7b666171-491b-4354-840d-8d5a3c707412 req-19aa3ca2-5ae5-41ee-be74-c9ea2287c1c6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033787 Jun 17 08:57:38.311950 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 410/814] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:57:38.792369 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d0401038-6340-47a0-8955-7e9ceeea75a3 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:38.793026 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-d0401038-6340-47a0-8955-7e9ceeea75a3 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:38.799162 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d0401038-6340-47a0-8955-7e9ceeea75a3 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:38.799649 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d0401038-6340-47a0-8955-7e9ceeea75a3 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:38.800438 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d0401038-6340-47a0-8955-7e9ceeea75a3 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:38.800873 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d0401038-6340-47a0-8955-7e9ceeea75a3 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:38.982845 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d0401038-6340-47a0-8955-7e9ceeea75a3 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:38.991246 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-d0401038-6340-47a0-8955-7e9ceeea75a3 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1569 microversion: 2.1 time: 0.202746 Jun 17 08:57:38.991948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 405/815] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:38 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:39.109075 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-c89b3961-7de4-4560-aa0d-270abccdb850 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:39.110870 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-c89b3961-7de4-4560-aa0d-270abccdb850 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:39.121452 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c89b3961-7de4-4560-aa0d-270abccdb850 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:39.122488 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c89b3961-7de4-4560-aa0d-270abccdb850 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:39.124087 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c89b3961-7de4-4560-aa0d-270abccdb850 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:39.125313 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c89b3961-7de4-4560-aa0d-270abccdb850 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:39.159254 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c89b3961-7de4-4560-aa0d-270abccdb850 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:39.159847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c89b3961-7de4-4560-aa0d-270abccdb850 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:39.160329 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.objects.instance [None req-c89b3961-7de4-4560-aa0d-270abccdb850 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lazy-loading 'fault' on Instance uuid fab8f2eb-71c8-4956-b693-06f73bf86964 {{(pid=129876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:57:39.204472 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c89b3961-7de4-4560-aa0d-270abccdb850 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:39.214365 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-c89b3961-7de4-4560-aa0d-270abccdb850 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964" status: 200 len: 1331 microversion: 2.1 time: 0.129667 Jun 17 08:57:39.215152 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 411/816] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:39 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 => generated 1331 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:40.009734 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-bf368c09-2412-433f-ba4a-382c1ee7d15e tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:40.010528 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-bf368c09-2412-433f-ba4a-382c1ee7d15e tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:40.017882 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bf368c09-2412-433f-ba4a-382c1ee7d15e tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:40.018558 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bf368c09-2412-433f-ba4a-382c1ee7d15e tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:40.020088 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bf368c09-2412-433f-ba4a-382c1ee7d15e tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:40.020606 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bf368c09-2412-433f-ba4a-382c1ee7d15e tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:40.169270 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-bf368c09-2412-433f-ba4a-382c1ee7d15e tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:40.179139 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-bf368c09-2412-433f-ba4a-382c1ee7d15e tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1569 microversion: 2.1 time: 0.173750 Jun 17 08:57:40.179797 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 406/817] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:40 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:40.231763 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-37db2920-821e-44f3-bf13-9fa9c8fad5a9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:40.232313 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-37db2920-821e-44f3-bf13-9fa9c8fad5a9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:40.239405 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-37db2920-821e-44f3-bf13-9fa9c8fad5a9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:40.239858 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-37db2920-821e-44f3-bf13-9fa9c8fad5a9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:40.240630 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-37db2920-821e-44f3-bf13-9fa9c8fad5a9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:40.241059 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-37db2920-821e-44f3-bf13-9fa9c8fad5a9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:40.256368 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-37db2920-821e-44f3-bf13-9fa9c8fad5a9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] HTTP exception thrown: Instance fab8f2eb-71c8-4956-b693-06f73bf86964 could not be found. Jun 17 08:57:40.258233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-37db2920-821e-44f3-bf13-9fa9c8fad5a9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Request method failure captured: Jun 17 08:57:40.258233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 HTTP/1.1 Jun 17 08:57:40.258233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:57:40.258233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:57:40.258233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:57:40.258233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 08:57:40.258233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:57:40.258233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:57:40.258233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:57:40.258233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:57:40.258233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirECoefK_2BxjZgVOeODeD0JulOcw4b3dCrWlpFY_cQoAEUxcK30AdtBELaLH-kVfcQ6VKJx7aLTz7Z0L639CzJLSrkIUHMaE3fnQwSThKfCgM9dozYdAIITDcNAYtXkDc4HYT-B7uJX_QV7RNcl_PdXigEFPXJ9IRk3STBItMRTcdRI Jun 17 08:57:40.258233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:57:40.258233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:57:40.258233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:57:40.258233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:57:40.258233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:57:40.258233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:57:40.258233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:57:40.258233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:57:40.258233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:57:40.258233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:57:40.259894 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}] Jun 17 08:57:40.259894 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:57:40.259894 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:57:40.259894 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:57:40.259894 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:57:40.259894 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:57:40.259894 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:57:40.259894 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: 01bb3df8b4b649388d1a0f6c24e18f1b Jun 17 08:57:40.259894 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:57:40.259894 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 08:57:40.259894 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Instance fab8f2eb-71c8-4956-b693-06f73bf86964 could not be found. Jun 17 08:57:40.259894 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'id': 'fab8f2eb-71c8-4956-b693-06f73bf86964'} Jun 17 08:57:40.261405 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:57:40.261405 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:57:40.261405 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:57:40.261405 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:57:40.261405 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:57:40.261405 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:57:40.261405 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:57:40.261405 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:57:40.261405 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:57:40.261405 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:57:40.261405 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fab8f2eb-71c8-4956-b693-06f73bf86964 could not be found. Jun 17 08:57:40.261405 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:57:40.261405 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:57:40.261405 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:57:40.261405 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:57:40.261405 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:57:40.261405 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:57:40.261405 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:57:40.261405 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:57:40.261405 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:57:40.262795 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:57:40.262795 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:57:40.262795 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:57:40.262795 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:57:40.262795 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:57:40.262795 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:57:40.262795 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:57:40.262795 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fab8f2eb-71c8-4956-b693-06f73bf86964 could not be found. Jun 17 08:57:40.262795 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:57:40.262795 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:57:40.262795 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:57:40.262795 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:57:40.262795 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:57:40.262795 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:57:40.262795 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:57:40.262795 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:57:40.262795 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fab8f2eb-71c8-4956-b693-06f73bf86964 could not be found. Jun 17 08:57:40.262795 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:57:40.264891 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-37db2920-821e-44f3-bf13-9fa9c8fad5a9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Returning 404 to user: Instance fab8f2eb-71c8-4956-b693-06f73bf86964 could not be found. {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:57:40.264891 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-37db2920-821e-44f3-bf13-9fa9c8fad5a9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964" status: 404 len: 111 microversion: 2.1 time: 0.031856 Jun 17 08:57:40.264891 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 412/818] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:40 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 08:57:40.269623 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-5145f8cd-5a8f-4e41-8396-52847d8b62ce tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '.version_select at 0x7fbc401f98b0>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:40.340453 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-5145f8cd-5a8f-4e41-8396-52847d8b62ce tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2080434707" status: 202 len: 0 microversion: 2.1 time: 0.075397 Jun 17 08:57:40.341094 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 407/819] 10.222.0.78 () {58 vars in 1220 bytes} [Fri Jun 17 08:57:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2080434707 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:57:41.196720 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-7eb151d5-f0bf-4cb6-80c7-4d59d013bed9 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:41.197596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-7eb151d5-f0bf-4cb6-80c7-4d59d013bed9 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:41.207794 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7eb151d5-f0bf-4cb6-80c7-4d59d013bed9 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:41.208248 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7eb151d5-f0bf-4cb6-80c7-4d59d013bed9 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:41.209014 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7eb151d5-f0bf-4cb6-80c7-4d59d013bed9 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:41.209448 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7eb151d5-f0bf-4cb6-80c7-4d59d013bed9 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:41.316099 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-6304a213-2454-4e7c-8df5-28c776a1bd10 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Action: 'create', calling method: .version_select at 0x7fbc4015f280>, body: {"keypair": {"name": "tempest-keypair-9423753", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWQDCjvEcIl6LXwZy36fUBxlSkCOSDIPwTerxd3+i73N6ib4iiho3XA6saK52hoqpAnih0tCK1fH4S2XIWbc/OTIiSegdUswNTBHjDbFN8BRtjYn/0PbNdbqFVieJ3NAg=="}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:57:41.335572 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-6304a213-2454-4e7c-8df5-28c776a1bd10 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Getting quotas for project 794e7ebcf5c3436081b8e8d39907b655. Resources: {'key_pairs'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:57:41.340262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-6304a213-2454-4e7c-8df5-28c776a1bd10 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Getting quotas for user 01bb3df8b4b649388d1a0f6c24e18f1b and project 794e7ebcf5c3436081b8e8d39907b655. Resources: {'key_pairs'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:57:41.368429 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-7eb151d5-f0bf-4cb6-80c7-4d59d013bed9 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:41.376722 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-7eb151d5-f0bf-4cb6-80c7-4d59d013bed9 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1569 microversion: 2.1 time: 0.183706 Jun 17 08:57:41.377350 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 413/820] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:41 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:41.461126 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-6304a213-2454-4e7c-8df5-28c776a1bd10 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.151864 Jun 17 08:57:41.470267 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 408/821] 10.222.0.78 () {60 vars in 1158 bytes} [Fri Jun 17 08:57:41 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:57:42.395384 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-b48a5f88-07d7-4a1b-9c6d-894d97d64b41 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:42.396047 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-b48a5f88-07d7-4a1b-9c6d-894d97d64b41 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:42.402958 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b48a5f88-07d7-4a1b-9c6d-894d97d64b41 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:42.403502 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b48a5f88-07d7-4a1b-9c6d-894d97d64b41 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:42.404281 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b48a5f88-07d7-4a1b-9c6d-894d97d64b41 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:42.404943 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b48a5f88-07d7-4a1b-9c6d-894d97d64b41 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:42.603389 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-b48a5f88-07d7-4a1b-9c6d-894d97d64b41 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:42.611114 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-b48a5f88-07d7-4a1b-9c6d-894d97d64b41 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1569 microversion: 2.1 time: 0.220902 Jun 17 08:57:42.611944 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 414/822] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:42 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:57:43.629249 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-13b572b0-583a-4cdc-868c-b56010680e17 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:43.630000 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-13b572b0-583a-4cdc-868c-b56010680e17 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:43.636832 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-13b572b0-583a-4cdc-868c-b56010680e17 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:43.637282 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-13b572b0-583a-4cdc-868c-b56010680e17 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:43.638281 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-13b572b0-583a-4cdc-868c-b56010680e17 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:43.638724 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-13b572b0-583a-4cdc-868c-b56010680e17 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:43.892760 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-13b572b0-583a-4cdc-868c-b56010680e17 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:43.900794 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-13b572b0-583a-4cdc-868c-b56010680e17 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1569 microversion: 2.1 time: 0.276137 Jun 17 08:57:43.905032 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 409/823] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:43 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1569 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:57:44.394965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-3593d92b-19de-4830-a78d-3c4374cb58b9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-512205187", "imageRef": "978084c7-ed2c-4e42-ac8b-f5d19c4001fe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5af04e5-5681-4034-bf01-a7f9807128a2"}], "security_groups": [{"name": "tempest-securitygroup--493460418"}], "key_name": "tempest-keypair-9423753", "user_data": "}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:57:44.563761 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.network.neutron [None req-3593d92b-19de-4830-a78d-3c4374cb58b9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] validate_networks() for [('b5af04e5-5681-4034-bf01-a7f9807128a2', None, None, None, None, None)] {{(pid=129876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:57:44.924334 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0e9ddadc-7e63-47fa-89cd-a018efb6cd4d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:44.924334 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0e9ddadc-7e63-47fa-89cd-a018efb6cd4d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:44.931542 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0e9ddadc-7e63-47fa-89cd-a018efb6cd4d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:44.932249 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0e9ddadc-7e63-47fa-89cd-a018efb6cd4d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:44.933055 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0e9ddadc-7e63-47fa-89cd-a018efb6cd4d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:44.933645 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0e9ddadc-7e63-47fa-89cd-a018efb6cd4d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:45.192317 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0e9ddadc-7e63-47fa-89cd-a018efb6cd4d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:45.202811 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0e9ddadc-7e63-47fa-89cd-a018efb6cd4d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1569 microversion: 2.1 time: 0.287267 Jun 17 08:57:45.203884 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 410/824] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:44 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1569 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:45.276147 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-3593d92b-19de-4830-a78d-3c4374cb58b9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Flavor limits 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:57:45.276786 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-3593d92b-19de-4830-a78d-3c4374cb58b9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Image limits 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:57:45.277294 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-3593d92b-19de-4830-a78d-3c4374cb58b9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Flavor pref 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:57:45.277708 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-3593d92b-19de-4830-a78d-3c4374cb58b9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Image pref 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:57:45.278126 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-3593d92b-19de-4830-a78d-3c4374cb58b9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:57:45.287706 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3593d92b-19de-4830-a78d-3c4374cb58b9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:45.288154 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3593d92b-19de-4830-a78d-3c4374cb58b9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:45.289028 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3593d92b-19de-4830-a78d-3c4374cb58b9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:45.289463 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3593d92b-19de-4830-a78d-3c4374cb58b9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:45.308897 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-3593d92b-19de-4830-a78d-3c4374cb58b9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Getting quotas for project 794e7ebcf5c3436081b8e8d39907b655. Resources: {'ram', 'cores', 'instances'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:57:45.313461 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-3593d92b-19de-4830-a78d-3c4374cb58b9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Getting quotas for user 01bb3df8b4b649388d1a0f6c24e18f1b and project 794e7ebcf5c3436081b8e8d39907b655. Resources: {'ram', 'cores', 'instances'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:57:45.325617 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-3593d92b-19de-4830-a78d-3c4374cb58b9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Going to run 1 instances... {{(pid=129876) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:57:45.327959 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-3593d92b-19de-4830-a78d-3c4374cb58b9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='978084c7-ed2c-4e42-ac8b-f5d19c4001fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:57:45.685009 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-3593d92b-19de-4830-a78d-3c4374cb58b9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.294378 Jun 17 08:57:45.686710 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 415/825] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jun 17 08:57:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 1297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:57:45.708938 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-8c04c486-8502-4aa3-8d89-c97c60e24d9f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:45.710049 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-8c04c486-8502-4aa3-8d89-c97c60e24d9f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:45.844822 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-8c04c486-8502-4aa3-8d89-c97c60e24d9f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:45.854346 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-8c04c486-8502-4aa3-8d89-c97c60e24d9f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170" status: 200 len: 1238 microversion: 2.1 time: 0.160860 Jun 17 08:57:45.854943 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 411/826] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:45 2022] GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170 => generated 1238 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:46.066132 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-4ac6d552-5a7b-46db-a7f9-5b501a075abc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:46.067777 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-4ac6d552-5a7b-46db-a7f9-5b501a075abc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:46.081587 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4ac6d552-5a7b-46db-a7f9-5b501a075abc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:46.082609 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4ac6d552-5a7b-46db-a7f9-5b501a075abc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:46.083888 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4ac6d552-5a7b-46db-a7f9-5b501a075abc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:46.084482 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4ac6d552-5a7b-46db-a7f9-5b501a075abc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:46.131551 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-4ac6d552-5a7b-46db-a7f9-5b501a075abc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea/ips" status: 200 len: 151 microversion: 2.20 time: 0.070547 Jun 17 08:57:46.132141 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 416/827] 10.222.0.78 () {60 vars in 1288 bytes} [Fri Jun 17 08:57:46 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea/ips => generated 151 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:57:46.224141 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3ca720d5-7367-4a62-b822-48fe9c89acdb tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:46.225612 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-3ca720d5-7367-4a62-b822-48fe9c89acdb tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:46.241403 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3ca720d5-7367-4a62-b822-48fe9c89acdb tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:46.242242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3ca720d5-7367-4a62-b822-48fe9c89acdb tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:46.244067 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3ca720d5-7367-4a62-b822-48fe9c89acdb tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:46.246492 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3ca720d5-7367-4a62-b822-48fe9c89acdb tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:46.560226 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3ca720d5-7367-4a62-b822-48fe9c89acdb tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:46.565429 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:46.573821 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-3ca720d5-7367-4a62-b822-48fe9c89acdb tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1569 microversion: 2.1 time: 0.355470 Jun 17 08:57:46.574866 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 412/828] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:46 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1569 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:46.871689 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-b0aa1216-60ce-43b4-8c8a-b1a65b11e0c8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:46.872399 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-b0aa1216-60ce-43b4-8c8a-b1a65b11e0c8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:46.953343 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-b0aa1216-60ce-43b4-8c8a-b1a65b11e0c8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:46.963576 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-b0aa1216-60ce-43b4-8c8a-b1a65b11e0c8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170" status: 200 len: 1238 microversion: 2.1 time: 0.094835 Jun 17 08:57:46.964197 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 417/829] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:46 2022] GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170 => generated 1238 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:57:47.592290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a8ded47e-9d1f-4765-9780-13ca60f552e3 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:47.592903 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-a8ded47e-9d1f-4765-9780-13ca60f552e3 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:47.603785 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a8ded47e-9d1f-4765-9780-13ca60f552e3 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:47.604270 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a8ded47e-9d1f-4765-9780-13ca60f552e3 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:47.605112 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a8ded47e-9d1f-4765-9780-13ca60f552e3 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:47.605856 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a8ded47e-9d1f-4765-9780-13ca60f552e3 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:47.801443 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a8ded47e-9d1f-4765-9780-13ca60f552e3 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:47.812185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-a8ded47e-9d1f-4765-9780-13ca60f552e3 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1569 microversion: 2.1 time: 0.223593 Jun 17 08:57:47.813258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 413/830] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:47 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:47.987666 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-890c8ccc-66ec-4b58-8f4d-b9801abad3e4 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:47.988368 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-890c8ccc-66ec-4b58-8f4d-b9801abad3e4 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:48.007985 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-890c8ccc-66ec-4b58-8f4d-b9801abad3e4 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:48.008460 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-890c8ccc-66ec-4b58-8f4d-b9801abad3e4 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:48.009275 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-890c8ccc-66ec-4b58-8f4d-b9801abad3e4 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:48.009727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-890c8ccc-66ec-4b58-8f4d-b9801abad3e4 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:48.155027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-890c8ccc-66ec-4b58-8f4d-b9801abad3e4 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:48.168065 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-890c8ccc-66ec-4b58-8f4d-b9801abad3e4 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170" status: 200 len: 1290 microversion: 2.1 time: 0.184448 Jun 17 08:57:48.168973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 418/831] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:47 2022] GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170 => generated 1290 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:48.655392 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-91b4feef-93e5-49ee-96cf-dd9f56463448 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:57:48.656152 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-91b4feef-93e5-49ee-96cf-dd9f56463448 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:48.661053 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:48.665697 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-91b4feef-93e5-49ee-96cf-dd9f56463448 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:48.668108 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-91b4feef-93e5-49ee-96cf-dd9f56463448 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:48.677816 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-91b4feef-93e5-49ee-96cf-dd9f56463448 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:48.677816 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-91b4feef-93e5-49ee-96cf-dd9f56463448 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:48.709896 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-91b4feef-93e5-49ee-96cf-dd9f56463448 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lazy-loading 'flavor' on Instance uuid 2b18a4b5-273d-4ec1-81a8-ca670de385ea {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:57:48.831787 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-0d463905-63b8-48b1-a895-4a6ef4631261 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:48.832905 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-0d463905-63b8-48b1-a895-4a6ef4631261 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:48.858618 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0d463905-63b8-48b1-a895-4a6ef4631261 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:48.872836 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0d463905-63b8-48b1-a895-4a6ef4631261 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:48.886437 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0d463905-63b8-48b1-a895-4a6ef4631261 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:48.886974 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0d463905-63b8-48b1-a895-4a6ef4631261 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:49.187994 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-0d463905-63b8-48b1-a895-4a6ef4631261 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:49.195092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-0d463905-63b8-48b1-a895-4a6ef4631261 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1510 microversion: 2.1 time: 0.368826 Jun 17 08:57:49.198755 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 419/832] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:48 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1510 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:49.207704 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-07e9b33d-b9b9-4a29-ad1d-04e05ebfee30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:49.208605 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-07e9b33d-b9b9-4a29-ad1d-04e05ebfee30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:49.228492 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-07e9b33d-b9b9-4a29-ad1d-04e05ebfee30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:49.229030 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-07e9b33d-b9b9-4a29-ad1d-04e05ebfee30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:49.229936 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-07e9b33d-b9b9-4a29-ad1d-04e05ebfee30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:49.230387 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-07e9b33d-b9b9-4a29-ad1d-04e05ebfee30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:49.376650 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-91b4feef-93e5-49ee-96cf-dd9f56463448 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "POST /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea/action" status: 202 len: 0 microversion: 2.20 time: 0.724590 Jun 17 08:57:49.377652 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-07e9b33d-b9b9-4a29-ad1d-04e05ebfee30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:49.381592 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 414/833] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jun 17 08:57:48 2022] POST /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea/action => generated 0 bytes in 728 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:57:49.387591 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0349fb5c-26d4-4bab-8bae-a789c3a4ac51 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:57:49.388530 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0349fb5c-26d4-4bab-8bae-a789c3a4ac51 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:49.391666 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-07e9b33d-b9b9-4a29-ad1d-04e05ebfee30 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170" status: 200 len: 1296 microversion: 2.1 time: 0.191241 Jun 17 08:57:49.392853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 420/834] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:49 2022] GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170 => generated 1296 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:49.399062 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-88c5be25-9c68-4f63-9e3d-14704a819c69 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:49.399944 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-88c5be25-9c68-4f63-9e3d-14704a819c69 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:49.406775 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-88c5be25-9c68-4f63-9e3d-14704a819c69 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:49.409451 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-88c5be25-9c68-4f63-9e3d-14704a819c69 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:49.409451 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-88c5be25-9c68-4f63-9e3d-14704a819c69 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:49.409451 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-88c5be25-9c68-4f63-9e3d-14704a819c69 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:49.410154 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0349fb5c-26d4-4bab-8bae-a789c3a4ac51 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:49.411280 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0349fb5c-26d4-4bab-8bae-a789c3a4ac51 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:49.412124 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0349fb5c-26d4-4bab-8bae-a789c3a4ac51 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:49.412647 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0349fb5c-26d4-4bab-8bae-a789c3a4ac51 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:49.730412 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-88c5be25-9c68-4f63-9e3d-14704a819c69 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:49.744868 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-88c5be25-9c68-4f63-9e3d-14704a819c69 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:49.746751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-88c5be25-9c68-4f63-9e3d-14704a819c69 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:49.748026 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-88c5be25-9c68-4f63-9e3d-14704a819c69 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1722 microversion: 2.20 time: 0.353260 Jun 17 08:57:49.749140 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 421/835] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:57:49 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1722 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:57:49.889758 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0349fb5c-26d4-4bab-8bae-a789c3a4ac51 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "POST /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8/action" status: 202 len: 0 microversion: 2.1 time: 0.507491 Jun 17 08:57:49.889758 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 415/836] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jun 17 08:57:49 2022] POST /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:57:49.902239 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-4644742c-ebf5-44e6-8877-c182b976ad7c tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:49.903470 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-4644742c-ebf5-44e6-8877-c182b976ad7c tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:49.913247 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4644742c-ebf5-44e6-8877-c182b976ad7c tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:49.919543 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4644742c-ebf5-44e6-8877-c182b976ad7c tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:49.919543 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4644742c-ebf5-44e6-8877-c182b976ad7c tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:49.919543 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4644742c-ebf5-44e6-8877-c182b976ad7c tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:50.410334 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3c61e1bc-6561-4c14-b4a6-f73296a338e4 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:50.412273 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-3c61e1bc-6561-4c14-b4a6-f73296a338e4 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:50.427831 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3c61e1bc-6561-4c14-b4a6-f73296a338e4 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:50.428340 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3c61e1bc-6561-4c14-b4a6-f73296a338e4 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:50.429342 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3c61e1bc-6561-4c14-b4a6-f73296a338e4 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:50.429862 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3c61e1bc-6561-4c14-b4a6-f73296a338e4 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:50.723850 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-4644742c-ebf5-44e6-8877-c182b976ad7c tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:50.736943 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-4644742c-ebf5-44e6-8877-c182b976ad7c tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1518 microversion: 2.1 time: 0.839909 Jun 17 08:57:50.747832 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 422/837] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:49 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1518 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:50.915263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-6403abaf-1d87-47c5-b52d-5d5b697d096b req-e0d550b0-000f-499f-8bb4-ab78abe485d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e32781c-7056-4c56-a02d-4c94cbc414f8", "name": "network-vif-unplugged", "status": "completed", "tag": "3b983d08-82e5-4031-8c13-d190ca57fc87"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:57:50.927886 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-6403abaf-1d87-47c5-b52d-5d5b697d096b req-e0d550b0-000f-499f-8bb4-ab78abe485d4 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:50.928619 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-6403abaf-1d87-47c5-b52d-5d5b697d096b req-e0d550b0-000f-499f-8bb4-ab78abe485d4 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:50.955603 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3c61e1bc-6561-4c14-b4a6-f73296a338e4 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:50.959728 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.compute.server_external_events [req-6403abaf-1d87-47c5-b52d-5d5b697d096b req-e0d550b0-000f-499f-8bb4-ab78abe485d4 service nova] Unable to find a host for instance 8e32781c-7056-4c56-a02d-4c94cbc414f8. Dropping event network-vif-unplugged {{(pid=129876) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 17 08:57:50.966029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-3c61e1bc-6561-4c14-b4a6-f73296a338e4 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170" status: 200 len: 1363 microversion: 2.1 time: 0.559688 Jun 17 08:57:50.967559 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 416/838] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:50 2022] GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170 => generated 1363 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:50.973390 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-f3f15fe3-6d89-48d6-bdb2-deaf26692743 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:50.974129 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-f3f15fe3-6d89-48d6-bdb2-deaf26692743 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:50.976646 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-6403abaf-1d87-47c5-b52d-5d5b697d096b req-e0d550b0-000f-499f-8bb4-ab78abe485d4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.214790 Jun 17 08:57:50.980279 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 423/839] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 231 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 17 08:57:50.987391 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f3f15fe3-6d89-48d6-bdb2-deaf26692743 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:50.987918 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f3f15fe3-6d89-48d6-bdb2-deaf26692743 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:50.988863 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f3f15fe3-6d89-48d6-bdb2-deaf26692743 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:50.989301 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f3f15fe3-6d89-48d6-bdb2-deaf26692743 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:51.368261 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f3f15fe3-6d89-48d6-bdb2-deaf26692743 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:51.381315 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f3f15fe3-6d89-48d6-bdb2-deaf26692743 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:51.395803 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f3f15fe3-6d89-48d6-bdb2-deaf26692743 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:51.404317 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-f3f15fe3-6d89-48d6-bdb2-deaf26692743 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1722 microversion: 2.20 time: 0.430583 Jun 17 08:57:51.404317 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 417/840] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:57:50 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1722 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:57:51.755227 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-3e0076cb-26c0-4530-b8ac-f4afd99a5f19 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:51.755898 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-3e0076cb-26c0-4530-b8ac-f4afd99a5f19 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:51.762731 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3e0076cb-26c0-4530-b8ac-f4afd99a5f19 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:51.763187 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3e0076cb-26c0-4530-b8ac-f4afd99a5f19 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:51.764125 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3e0076cb-26c0-4530-b8ac-f4afd99a5f19 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:51.764429 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3e0076cb-26c0-4530-b8ac-f4afd99a5f19 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:51.985612 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-8a582c6c-15dd-43e5-a704-ee73ab3d371e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:51.986385 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-8a582c6c-15dd-43e5-a704-ee73ab3d371e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:51.999566 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8a582c6c-15dd-43e5-a704-ee73ab3d371e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:52.000935 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8a582c6c-15dd-43e5-a704-ee73ab3d371e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:52.003077 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8a582c6c-15dd-43e5-a704-ee73ab3d371e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:52.003756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8a582c6c-15dd-43e5-a704-ee73ab3d371e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:52.300681 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-3e0076cb-26c0-4530-b8ac-f4afd99a5f19 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:52.310780 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-3e0076cb-26c0-4530-b8ac-f4afd99a5f19 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1520 microversion: 2.1 time: 0.560502 Jun 17 08:57:52.311403 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 424/841] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:51 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1520 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:52.384364 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-8a582c6c-15dd-43e5-a704-ee73ab3d371e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:52.410246 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-8a582c6c-15dd-43e5-a704-ee73ab3d371e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170" status: 200 len: 1363 microversion: 2.1 time: 0.429253 Jun 17 08:57:52.423460 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 418/842] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:51 2022] GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170 => generated 1363 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:52.426401 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e4a448c8-8754-4e20-a6f4-16764a109d84 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:52.427032 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-e4a448c8-8754-4e20-a6f4-16764a109d84 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:52.437111 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e4a448c8-8754-4e20-a6f4-16764a109d84 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:52.437582 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e4a448c8-8754-4e20-a6f4-16764a109d84 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:52.438732 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e4a448c8-8754-4e20-a6f4-16764a109d84 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:52.439193 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e4a448c8-8754-4e20-a6f4-16764a109d84 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:52.803124 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e4a448c8-8754-4e20-a6f4-16764a109d84 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:52.812947 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e4a448c8-8754-4e20-a6f4-16764a109d84 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:52.814680 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e4a448c8-8754-4e20-a6f4-16764a109d84 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:52.815930 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-e4a448c8-8754-4e20-a6f4-16764a109d84 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1722 microversion: 2.20 time: 0.400798 Jun 17 08:57:52.817548 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 425/843] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:57:52 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1722 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:57:53.053285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-eb42af40-db78-450f-9e78-0b96bf31cce6 req-ffda3c5d-8e04-4bf3-a908-e8fdfbfa34b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2167779f-efa1-428a-9841-1863be4d7170", "tag": "44844b56-2912-46ac-a3c4-665b072ff6da"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:57:53.067570 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-eb42af40-db78-450f-9e78-0b96bf31cce6 req-ffda3c5d-8e04-4bf3-a908-e8fdfbfa34b7 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:53.068017 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-eb42af40-db78-450f-9e78-0b96bf31cce6 req-ffda3c5d-8e04-4bf3-a908-e8fdfbfa34b7 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:53.081393 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-eb42af40-db78-450f-9e78-0b96bf31cce6 req-ffda3c5d-8e04-4bf3-a908-e8fdfbfa34b7 service nova] Creating event network-changed:44844b56-2912-46ac-a3c4-665b072ff6da for instance 2167779f-efa1-428a-9841-1863be4d7170 on hv-cinder-79760 Jun 17 08:57:53.086651 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-eb42af40-db78-450f-9e78-0b96bf31cce6 req-ffda3c5d-8e04-4bf3-a908-e8fdfbfa34b7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042094 Jun 17 08:57:53.087923 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 419/844] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:57:53.330819 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-fbca6d49-ab1c-4e73-9722-cf7475584ccc tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:53.331966 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-fbca6d49-ab1c-4e73-9722-cf7475584ccc tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:53.338836 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fbca6d49-ab1c-4e73-9722-cf7475584ccc tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:53.355919 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fbca6d49-ab1c-4e73-9722-cf7475584ccc tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:53.355919 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fbca6d49-ab1c-4e73-9722-cf7475584ccc tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:53.355919 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fbca6d49-ab1c-4e73-9722-cf7475584ccc tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:53.431315 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-606537e2-6d17-4b00-b4a0-bef0af502964 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:53.432425 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-606537e2-6d17-4b00-b4a0-bef0af502964 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:53.439958 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-606537e2-6d17-4b00-b4a0-bef0af502964 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:53.441849 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-606537e2-6d17-4b00-b4a0-bef0af502964 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:53.441849 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-606537e2-6d17-4b00-b4a0-bef0af502964 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:53.442045 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-606537e2-6d17-4b00-b4a0-bef0af502964 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:53.967602 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-fbca6d49-ab1c-4e73-9722-cf7475584ccc tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:53.976496 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:53.991076 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-fbca6d49-ab1c-4e73-9722-cf7475584ccc tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1576 microversion: 2.1 time: 0.664784 Jun 17 08:57:54.002791 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 426/845] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:53 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1576 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:54.021533 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-32fcf156-e3dd-49ce-8b68-b455c1baeebf tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:54.023550 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-32fcf156-e3dd-49ce-8b68-b455c1baeebf tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:54.043188 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-32fcf156-e3dd-49ce-8b68-b455c1baeebf tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:54.043708 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-32fcf156-e3dd-49ce-8b68-b455c1baeebf tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:54.044480 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-32fcf156-e3dd-49ce-8b68-b455c1baeebf tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:54.046055 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-32fcf156-e3dd-49ce-8b68-b455c1baeebf tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:54.164310 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-606537e2-6d17-4b00-b4a0-bef0af502964 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:54.174517 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-606537e2-6d17-4b00-b4a0-bef0af502964 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170" status: 200 len: 1363 microversion: 2.1 time: 0.748608 Jun 17 08:57:54.175127 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 420/846] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:53 2022] GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170 => generated 1363 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:54.456323 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-32fcf156-e3dd-49ce-8b68-b455c1baeebf tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:54.468482 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-32fcf156-e3dd-49ce-8b68-b455c1baeebf tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:54.471383 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-32fcf156-e3dd-49ce-8b68-b455c1baeebf tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:54.473114 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-32fcf156-e3dd-49ce-8b68-b455c1baeebf tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1722 microversion: 2.20 time: 0.478216 Jun 17 08:57:54.475395 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 427/847] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:57:53 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1722 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:57:55.012898 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-b19f2401-e652-4728-96e4-230255903798 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:55.013462 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-b19f2401-e652-4728-96e4-230255903798 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:55.022259 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b19f2401-e652-4728-96e4-230255903798 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:55.022958 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b19f2401-e652-4728-96e4-230255903798 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:55.024073 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b19f2401-e652-4728-96e4-230255903798 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:55.028071 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b19f2401-e652-4728-96e4-230255903798 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:55.192093 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-1f7afd37-00f5-4113-b6a2-8ff6afd81ff9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:55.194124 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-1f7afd37-00f5-4113-b6a2-8ff6afd81ff9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:55.202719 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1f7afd37-00f5-4113-b6a2-8ff6afd81ff9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:55.203168 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1f7afd37-00f5-4113-b6a2-8ff6afd81ff9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:55.204427 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1f7afd37-00f5-4113-b6a2-8ff6afd81ff9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:55.205385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1f7afd37-00f5-4113-b6a2-8ff6afd81ff9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:55.242307 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b19f2401-e652-4728-96e4-230255903798 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:55.252717 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-b19f2401-e652-4728-96e4-230255903798 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1576 microversion: 2.1 time: 0.245768 Jun 17 08:57:55.253557 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 421/848] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:55 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1576 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:55.299155 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=2 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:55.427940 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-1f7afd37-00f5-4113-b6a2-8ff6afd81ff9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:55.436744 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-1f7afd37-00f5-4113-b6a2-8ff6afd81ff9 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170" status: 200 len: 1363 microversion: 2.1 time: 0.248824 Jun 17 08:57:55.445630 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 428/849] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:55 2022] GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:55.496727 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-f495e874-f061-4615-971a-e788a623949c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:55.497586 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-f495e874-f061-4615-971a-e788a623949c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:55.504667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f495e874-f061-4615-971a-e788a623949c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:55.505195 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f495e874-f061-4615-971a-e788a623949c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:55.505975 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f495e874-f061-4615-971a-e788a623949c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:55.506618 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f495e874-f061-4615-971a-e788a623949c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:55.845276 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f495e874-f061-4615-971a-e788a623949c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:55.851168 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=6 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:55.854453 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f495e874-f061-4615-971a-e788a623949c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:55.856673 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f495e874-f061-4615-971a-e788a623949c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:55.857911 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-f495e874-f061-4615-971a-e788a623949c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1722 microversion: 2.20 time: 0.365843 Jun 17 08:57:55.860926 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 422/850] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:57:55 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1722 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:57:56.274054 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-fe003137-0f6e-4666-97b7-f60ba9ef86dd tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:56.275197 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-fe003137-0f6e-4666-97b7-f60ba9ef86dd tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:56.279406 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:56.295980 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fe003137-0f6e-4666-97b7-f60ba9ef86dd tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:56.296748 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fe003137-0f6e-4666-97b7-f60ba9ef86dd tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:56.298110 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fe003137-0f6e-4666-97b7-f60ba9ef86dd tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:56.307527 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fe003137-0f6e-4666-97b7-f60ba9ef86dd tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:56.454709 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-182ffdc5-3b40-44b5-9d53-3f8dc093b34c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:56.455841 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-182ffdc5-3b40-44b5-9d53-3f8dc093b34c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:56.468484 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-182ffdc5-3b40-44b5-9d53-3f8dc093b34c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:56.469392 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-182ffdc5-3b40-44b5-9d53-3f8dc093b34c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:56.470309 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-182ffdc5-3b40-44b5-9d53-3f8dc093b34c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:56.471508 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-182ffdc5-3b40-44b5-9d53-3f8dc093b34c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:56.539966 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-fe003137-0f6e-4666-97b7-f60ba9ef86dd tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:56.548845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-fe003137-0f6e-4666-97b7-f60ba9ef86dd tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1576 microversion: 2.1 time: 0.282126 Jun 17 08:57:56.549454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 429/851] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:56 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1576 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:56.736608 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-182ffdc5-3b40-44b5-9d53-3f8dc093b34c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:56.744692 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-182ffdc5-3b40-44b5-9d53-3f8dc093b34c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170" status: 200 len: 1363 microversion: 2.1 time: 0.294272 Jun 17 08:57:56.745344 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 423/852] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:56 2022] GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170 => generated 1363 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:56.864984 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-b2a49bac-72f6-42a9-84bc-53d2bd869805 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Action: 'create', calling method: .version_select at 0x7fbc443ed0d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-899283893", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5d31k0Jd0nzRrL4Cr93hyUtRkh4PcmM+JiKEz4TXEI5N7vLHkF0+6HQ+rGkia5/INTu6sZ8EGIzz9fM8EHWu2L58sQkn8uD6PgKz5fve0lEN6i3zsEKT4jcpZpMLTqgw=="}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:57:56.877497 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-93fa0db9-6cfa-4092-af74-30642b4cddfe tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:56.878749 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-93fa0db9-6cfa-4092-af74-30642b4cddfe tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:56.881056 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-b2a49bac-72f6-42a9-84bc-53d2bd869805 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Getting quotas for project 4c3ecf1efb8748a0af09e501e2b9d81b. Resources: {'key_pairs'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:57:56.885104 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-93fa0db9-6cfa-4092-af74-30642b4cddfe tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:56.885269 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-93fa0db9-6cfa-4092-af74-30642b4cddfe tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:56.885811 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-b2a49bac-72f6-42a9-84bc-53d2bd869805 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Getting quotas for user 61c06d41d371486c9856a17c5b2aee20 and project 4c3ecf1efb8748a0af09e501e2b9d81b. Resources: {'key_pairs'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:57:56.886265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-93fa0db9-6cfa-4092-af74-30642b4cddfe tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:56.886785 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-93fa0db9-6cfa-4092-af74-30642b4cddfe tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:57.009610 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-b2a49bac-72f6-42a9-84bc-53d2bd869805 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.250677 Jun 17 08:57:57.027818 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 430/853] 10.222.0.78 () {60 vars in 1158 bytes} [Fri Jun 17 08:57:56 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:57:57.068593 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-93fa0db9-6cfa-4092-af74-30642b4cddfe tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:57.076928 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-93fa0db9-6cfa-4092-af74-30642b4cddfe tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:57.078448 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-93fa0db9-6cfa-4092-af74-30642b4cddfe tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:57.079873 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-93fa0db9-6cfa-4092-af74-30642b4cddfe tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1722 microversion: 2.20 time: 0.206786 Jun 17 08:57:57.080364 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 424/854] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:57:56 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:57:57.567570 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-16185245-d9ff-4a35-bfd3-a7398e289fc0 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:57.568314 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-16185245-d9ff-4a35-bfd3-a7398e289fc0 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:57.574647 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-16185245-d9ff-4a35-bfd3-a7398e289fc0 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:57.575093 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-16185245-d9ff-4a35-bfd3-a7398e289fc0 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:57.575897 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-16185245-d9ff-4a35-bfd3-a7398e289fc0 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:57.576388 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-16185245-d9ff-4a35-bfd3-a7398e289fc0 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:57.740160 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-16185245-d9ff-4a35-bfd3-a7398e289fc0 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:57.749847 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-16185245-d9ff-4a35-bfd3-a7398e289fc0 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1576 microversion: 2.1 time: 0.186990 Jun 17 08:57:57.750993 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 431/855] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:57 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1576 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:57.766996 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a7757495-50b7-4ffb-ae5d-2343b2611b3a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:57.768217 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-a7757495-50b7-4ffb-ae5d-2343b2611b3a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:57.774661 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a7757495-50b7-4ffb-ae5d-2343b2611b3a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:57.775113 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a7757495-50b7-4ffb-ae5d-2343b2611b3a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:57.776216 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a7757495-50b7-4ffb-ae5d-2343b2611b3a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:57.776714 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a7757495-50b7-4ffb-ae5d-2343b2611b3a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:57.951633 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a7757495-50b7-4ffb-ae5d-2343b2611b3a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:57.963428 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-a7757495-50b7-4ffb-ae5d-2343b2611b3a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170" status: 200 len: 1363 microversion: 2.1 time: 0.200143 Jun 17 08:57:57.966460 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 425/856] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:57 2022] GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:58.099296 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-472da8b6-0ba8-4ff2-a929-93055ff47cfd tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:58.100243 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-472da8b6-0ba8-4ff2-a929-93055ff47cfd tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:58.107305 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-472da8b6-0ba8-4ff2-a929-93055ff47cfd tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:58.108278 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-472da8b6-0ba8-4ff2-a929-93055ff47cfd tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:58.109181 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-472da8b6-0ba8-4ff2-a929-93055ff47cfd tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:58.109679 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-472da8b6-0ba8-4ff2-a929-93055ff47cfd tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:58.252565 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-472da8b6-0ba8-4ff2-a929-93055ff47cfd tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:58.261077 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-472da8b6-0ba8-4ff2-a929-93055ff47cfd tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:58.262652 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-472da8b6-0ba8-4ff2-a929-93055ff47cfd tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:58.263834 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-472da8b6-0ba8-4ff2-a929-93055ff47cfd tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1722 microversion: 2.20 time: 0.169526 Jun 17 08:57:58.264473 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 432/857] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:57:58 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:57:58.570267 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-864589a0-03d8-4976-96c9-91057a064ff1 req-56e1262c-8daa-4fde-abba-1ea37bac0d45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2167779f-efa1-428a-9841-1863be4d7170", "name": "network-vif-plugged", "status": "completed", "tag": "44844b56-2912-46ac-a3c4-665b072ff6da"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:57:58.579504 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-864589a0-03d8-4976-96c9-91057a064ff1 req-56e1262c-8daa-4fde-abba-1ea37bac0d45 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:58.579504 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-864589a0-03d8-4976-96c9-91057a064ff1 req-56e1262c-8daa-4fde-abba-1ea37bac0d45 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:58.591551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-864589a0-03d8-4976-96c9-91057a064ff1 req-56e1262c-8daa-4fde-abba-1ea37bac0d45 service nova] Creating event network-vif-plugged:44844b56-2912-46ac-a3c4-665b072ff6da for instance 2167779f-efa1-428a-9841-1863be4d7170 on hv-cinder-79760 Jun 17 08:57:58.597122 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-864589a0-03d8-4976-96c9-91057a064ff1 req-56e1262c-8daa-4fde-abba-1ea37bac0d45 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030143 Jun 17 08:57:58.602062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 426/858] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:57:58.769772 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-d3e2f761-e392-4e5d-b99c-9a06ada216d5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:58.770309 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-d3e2f761-e392-4e5d-b99c-9a06ada216d5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:58.784627 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d3e2f761-e392-4e5d-b99c-9a06ada216d5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:58.785099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d3e2f761-e392-4e5d-b99c-9a06ada216d5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:58.787962 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d3e2f761-e392-4e5d-b99c-9a06ada216d5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:58.787962 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d3e2f761-e392-4e5d-b99c-9a06ada216d5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:58.981161 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-d3e2f761-e392-4e5d-b99c-9a06ada216d5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:58.982624 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-b71d8ac4-6709-4e6a-9328-345c4d8fecca tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:58.983985 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-b71d8ac4-6709-4e6a-9328-345c4d8fecca tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:58.991470 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b71d8ac4-6709-4e6a-9328-345c4d8fecca tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:58.992419 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b71d8ac4-6709-4e6a-9328-345c4d8fecca tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:58.992966 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-d3e2f761-e392-4e5d-b99c-9a06ada216d5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1576 microversion: 2.1 time: 0.227766 Jun 17 08:57:58.993858 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b71d8ac4-6709-4e6a-9328-345c4d8fecca tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:59.002428 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b71d8ac4-6709-4e6a-9328-345c4d8fecca tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:59.004366 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 433/859] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:58 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1576 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:59.143754 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b71d8ac4-6709-4e6a-9328-345c4d8fecca tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:59.146208 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:59.152317 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-b71d8ac4-6709-4e6a-9328-345c4d8fecca tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170" status: 200 len: 1363 microversion: 2.1 time: 0.174666 Jun 17 08:57:59.153234 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 427/860] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:58 2022] GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:57:59.282494 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-1a96c50a-4875-4de3-9ef8-01496a5ac51b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:59.282735 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-1a96c50a-4875-4de3-9ef8-01496a5ac51b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:59.291311 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1a96c50a-4875-4de3-9ef8-01496a5ac51b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:59.294545 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1a96c50a-4875-4de3-9ef8-01496a5ac51b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:59.299786 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1a96c50a-4875-4de3-9ef8-01496a5ac51b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:59.299786 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1a96c50a-4875-4de3-9ef8-01496a5ac51b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:59.495081 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-1a96c50a-4875-4de3-9ef8-01496a5ac51b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:59.506079 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-1a96c50a-4875-4de3-9ef8-01496a5ac51b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:59.507915 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-1a96c50a-4875-4de3-9ef8-01496a5ac51b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:59.509226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-1a96c50a-4875-4de3-9ef8-01496a5ac51b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1722 microversion: 2.20 time: 0.230981 Jun 17 08:57:59.509852 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 434/861] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:57:59 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:00.012354 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a9e307c7-6ba8-473f-8e5c-b0c35f3b8d91 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:00.012969 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-a9e307c7-6ba8-473f-8e5c-b0c35f3b8d91 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:00.021240 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a9e307c7-6ba8-473f-8e5c-b0c35f3b8d91 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:00.021522 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a9e307c7-6ba8-473f-8e5c-b0c35f3b8d91 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:00.022303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a9e307c7-6ba8-473f-8e5c-b0c35f3b8d91 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:00.025743 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a9e307c7-6ba8-473f-8e5c-b0c35f3b8d91 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:00.171204 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-0769c6cc-0c1f-40b5-bfce-9ad0b684f4af tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:00.173042 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-0769c6cc-0c1f-40b5-bfce-9ad0b684f4af tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:00.175557 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a9e307c7-6ba8-473f-8e5c-b0c35f3b8d91 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:00.181071 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0769c6cc-0c1f-40b5-bfce-9ad0b684f4af tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:00.181994 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0769c6cc-0c1f-40b5-bfce-9ad0b684f4af tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:00.183260 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0769c6cc-0c1f-40b5-bfce-9ad0b684f4af tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:00.183833 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-a9e307c7-6ba8-473f-8e5c-b0c35f3b8d91 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1576 microversion: 2.1 time: 0.175341 Jun 17 08:58:00.184143 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0769c6cc-0c1f-40b5-bfce-9ad0b684f4af tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:00.184413 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 428/862] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:00 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:00.529568 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-773e7774-6c67-4de0-97db-a71bef2cb268 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:00.530202 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-773e7774-6c67-4de0-97db-a71bef2cb268 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:00.536900 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-773e7774-6c67-4de0-97db-a71bef2cb268 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:00.537346 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-773e7774-6c67-4de0-97db-a71bef2cb268 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:00.538108 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-773e7774-6c67-4de0-97db-a71bef2cb268 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:00.538527 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-773e7774-6c67-4de0-97db-a71bef2cb268 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:00.622500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-0769c6cc-0c1f-40b5-bfce-9ad0b684f4af tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:00.630666 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-0769c6cc-0c1f-40b5-bfce-9ad0b684f4af tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170" status: 200 len: 1363 microversion: 2.1 time: 0.464373 Jun 17 08:58:00.631407 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 435/863] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:00 2022] GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170 => generated 1363 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:58:00.691119 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-773e7774-6c67-4de0-97db-a71bef2cb268 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:00.699245 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-773e7774-6c67-4de0-97db-a71bef2cb268 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:00.700839 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-773e7774-6c67-4de0-97db-a71bef2cb268 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:00.702002 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-773e7774-6c67-4de0-97db-a71bef2cb268 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1743 microversion: 2.20 time: 0.176632 Jun 17 08:58:00.702568 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 429/864] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:00 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1743 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:58:01.200780 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a918b11b-8fb5-44dd-b48a-9440f2032a3d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:01.201300 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a918b11b-8fb5-44dd-b48a-9440f2032a3d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:01.208592 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a918b11b-8fb5-44dd-b48a-9440f2032a3d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:01.209058 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a918b11b-8fb5-44dd-b48a-9440f2032a3d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:01.209843 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a918b11b-8fb5-44dd-b48a-9440f2032a3d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:01.210280 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a918b11b-8fb5-44dd-b48a-9440f2032a3d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:01.341217 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a918b11b-8fb5-44dd-b48a-9440f2032a3d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:01.348840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a918b11b-8fb5-44dd-b48a-9440f2032a3d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1576 microversion: 2.1 time: 0.152043 Jun 17 08:58:01.349410 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 436/865] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:01 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:01.648366 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-8da91f3e-8acf-43f9-8af2-b8e8bb28210e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:01.649042 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-8da91f3e-8acf-43f9-8af2-b8e8bb28210e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:01.656024 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8da91f3e-8acf-43f9-8af2-b8e8bb28210e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:01.656476 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8da91f3e-8acf-43f9-8af2-b8e8bb28210e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:01.657240 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8da91f3e-8acf-43f9-8af2-b8e8bb28210e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:01.658285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8da91f3e-8acf-43f9-8af2-b8e8bb28210e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:01.727339 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-bcc59eef-889a-4c53-916a-20d781253037 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:01.728303 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-bcc59eef-889a-4c53-916a-20d781253037 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:01.735999 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bcc59eef-889a-4c53-916a-20d781253037 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:01.737240 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bcc59eef-889a-4c53-916a-20d781253037 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:01.738221 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bcc59eef-889a-4c53-916a-20d781253037 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:01.739023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bcc59eef-889a-4c53-916a-20d781253037 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:01.857115 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-8da91f3e-8acf-43f9-8af2-b8e8bb28210e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:01.866100 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-8da91f3e-8acf-43f9-8af2-b8e8bb28210e tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170" status: 200 len: 1552 microversion: 2.1 time: 0.221789 Jun 17 08:58:01.878560 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 430/866] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:01 2022] GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170 => generated 1552 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:01.884123 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-bae8ef7c-f7ad-44f3-aa04-74c26792f1e5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:01.884712 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-bae8ef7c-f7ad-44f3-aa04-74c26792f1e5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:01.891003 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bae8ef7c-f7ad-44f3-aa04-74c26792f1e5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:01.891310 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bae8ef7c-f7ad-44f3-aa04-74c26792f1e5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:01.892685 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bae8ef7c-f7ad-44f3-aa04-74c26792f1e5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:01.893365 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bae8ef7c-f7ad-44f3-aa04-74c26792f1e5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:01.911312 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-bcc59eef-889a-4c53-916a-20d781253037 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:01.921217 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-bcc59eef-889a-4c53-916a-20d781253037 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:01.922755 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-bcc59eef-889a-4c53-916a-20d781253037 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:01.924233 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-bcc59eef-889a-4c53-916a-20d781253037 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1743 microversion: 2.20 time: 0.202207 Jun 17 08:58:01.924999 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 437/867] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:01 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1743 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:58:01.980155 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-bae8ef7c-f7ad-44f3-aa04-74c26792f1e5 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099859 Jun 17 08:58:01.980850 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 431/868] 10.222.0.78 () {58 vars in 1274 bytes} [Fri Jun 17 08:58:01 2022] GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:58:02.366277 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-64baea0e-c66d-4ab1-b638-92449afe9cb5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:02.367057 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-64baea0e-c66d-4ab1-b638-92449afe9cb5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:02.373740 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-64baea0e-c66d-4ab1-b638-92449afe9cb5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:02.374192 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-64baea0e-c66d-4ab1-b638-92449afe9cb5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:02.374949 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-64baea0e-c66d-4ab1-b638-92449afe9cb5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:02.375473 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-64baea0e-c66d-4ab1-b638-92449afe9cb5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:02.527879 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-64baea0e-c66d-4ab1-b638-92449afe9cb5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:02.537121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-64baea0e-c66d-4ab1-b638-92449afe9cb5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1576 microversion: 2.1 time: 0.174530 Jun 17 08:58:02.537715 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 438/869] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:02 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:02.944043 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-09b485c2-eaf3-40df-99dc-d99193389f26 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:02.944719 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-09b485c2-eaf3-40df-99dc-d99193389f26 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:02.950781 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-09b485c2-eaf3-40df-99dc-d99193389f26 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:02.951239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-09b485c2-eaf3-40df-99dc-d99193389f26 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:02.952056 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-09b485c2-eaf3-40df-99dc-d99193389f26 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:02.952495 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-09b485c2-eaf3-40df-99dc-d99193389f26 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:03.096533 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-09b485c2-eaf3-40df-99dc-d99193389f26 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:03.105979 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-09b485c2-eaf3-40df-99dc-d99193389f26 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:03.107978 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-09b485c2-eaf3-40df-99dc-d99193389f26 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:03.109467 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-09b485c2-eaf3-40df-99dc-d99193389f26 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1743 microversion: 2.20 time: 0.170433 Jun 17 08:58:03.114091 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 432/870] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:02 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:03.124687 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-6ea3fa5d-9385-4ba8-81bf-e31db3d56b23 req-f54a50a3-f925-4fc7-9aa8-12f2b9b74815 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2167779f-efa1-428a-9841-1863be4d7170", "tag": "44844b56-2912-46ac-a3c4-665b072ff6da"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:58:03.133708 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-6ea3fa5d-9385-4ba8-81bf-e31db3d56b23 req-f54a50a3-f925-4fc7-9aa8-12f2b9b74815 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:03.134277 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-6ea3fa5d-9385-4ba8-81bf-e31db3d56b23 req-f54a50a3-f925-4fc7-9aa8-12f2b9b74815 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:03.146132 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-6ea3fa5d-9385-4ba8-81bf-e31db3d56b23 req-f54a50a3-f925-4fc7-9aa8-12f2b9b74815 service nova] Creating event network-changed:44844b56-2912-46ac-a3c4-665b072ff6da for instance 2167779f-efa1-428a-9841-1863be4d7170 on hv-cinder-79760 Jun 17 08:58:03.155257 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-6ea3fa5d-9385-4ba8-81bf-e31db3d56b23 req-f54a50a3-f925-4fc7-9aa8-12f2b9b74815 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097602 Jun 17 08:58:03.156347 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 439/871] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:58:03.568705 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-82e10959-b409-4c18-86fe-e1996583b117 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:03.569324 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-82e10959-b409-4c18-86fe-e1996583b117 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:03.578413 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-82e10959-b409-4c18-86fe-e1996583b117 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:03.578878 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-82e10959-b409-4c18-86fe-e1996583b117 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:03.580774 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-82e10959-b409-4c18-86fe-e1996583b117 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:03.581208 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-82e10959-b409-4c18-86fe-e1996583b117 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:03.850266 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-82e10959-b409-4c18-86fe-e1996583b117 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:03.863933 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-82e10959-b409-4c18-86fe-e1996583b117 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1576 microversion: 2.1 time: 0.308650 Jun 17 08:58:03.865107 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 433/872] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:03 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1576 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:04.131395 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-c1adbb75-2467-4002-b6f9-59895c54bd82 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:04.132131 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-c1adbb75-2467-4002-b6f9-59895c54bd82 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:04.145485 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c1adbb75-2467-4002-b6f9-59895c54bd82 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:04.146309 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c1adbb75-2467-4002-b6f9-59895c54bd82 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:04.150132 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c1adbb75-2467-4002-b6f9-59895c54bd82 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:04.150973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c1adbb75-2467-4002-b6f9-59895c54bd82 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:04.380125 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c1adbb75-2467-4002-b6f9-59895c54bd82 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:04.394179 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c1adbb75-2467-4002-b6f9-59895c54bd82 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:04.398727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c1adbb75-2467-4002-b6f9-59895c54bd82 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:04.400934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-c1adbb75-2467-4002-b6f9-59895c54bd82 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1738 microversion: 2.20 time: 0.274497 Jun 17 08:58:04.401852 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 440/873] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:04 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1738 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:04.736265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-3fb78ead-92bc-4ead-9b1e-3ff610bcd405 req-b0b27f21-87a5-410c-b3bc-035189d2bfe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b18a4b5-273d-4ec1-81a8-ca670de385ea", "name": "network-vif-plugged", "status": "completed", "tag": "02d2e50f-49e7-4067-86ed-da24c07d5aea"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:58:04.761837 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-3fb78ead-92bc-4ead-9b1e-3ff610bcd405 req-b0b27f21-87a5-410c-b3bc-035189d2bfe5 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:04.762689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-3fb78ead-92bc-4ead-9b1e-3ff610bcd405 req-b0b27f21-87a5-410c-b3bc-035189d2bfe5 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:04.783329 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-3fb78ead-92bc-4ead-9b1e-3ff610bcd405 req-b0b27f21-87a5-410c-b3bc-035189d2bfe5 service nova] Creating event network-vif-plugged:02d2e50f-49e7-4067-86ed-da24c07d5aea for instance 2b18a4b5-273d-4ec1-81a8-ca670de385ea on hv-cinder-79760 Jun 17 08:58:04.789876 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-3fb78ead-92bc-4ead-9b1e-3ff610bcd405 req-b0b27f21-87a5-410c-b3bc-035189d2bfe5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070837 Jun 17 08:58:04.790628 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 434/874] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:58:04.881709 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-0acea5e3-3282-4617-8678-ee36772e5988 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:04.882849 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-0acea5e3-3282-4617-8678-ee36772e5988 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:04.895290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0acea5e3-3282-4617-8678-ee36772e5988 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:04.896020 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0acea5e3-3282-4617-8678-ee36772e5988 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:04.897685 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0acea5e3-3282-4617-8678-ee36772e5988 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:04.898115 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0acea5e3-3282-4617-8678-ee36772e5988 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:05.082821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-0acea5e3-3282-4617-8678-ee36772e5988 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:05.090897 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-0acea5e3-3282-4617-8678-ee36772e5988 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1576 microversion: 2.1 time: 0.213120 Jun 17 08:58:05.091940 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 441/875] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:04 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1576 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:05.422088 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-2673a60e-bca5-410c-aae8-a00bde3b61a8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:05.423061 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-2673a60e-bca5-410c-aae8-a00bde3b61a8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:05.439724 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2673a60e-bca5-410c-aae8-a00bde3b61a8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:05.440747 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2673a60e-bca5-410c-aae8-a00bde3b61a8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:05.441931 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2673a60e-bca5-410c-aae8-a00bde3b61a8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:05.442515 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2673a60e-bca5-410c-aae8-a00bde3b61a8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:05.620438 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2673a60e-bca5-410c-aae8-a00bde3b61a8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:05.632782 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2673a60e-bca5-410c-aae8-a00bde3b61a8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:05.635369 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2673a60e-bca5-410c-aae8-a00bde3b61a8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:05.636577 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-2673a60e-bca5-410c-aae8-a00bde3b61a8 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1738 microversion: 2.20 time: 0.219859 Jun 17 08:58:05.637487 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 435/876] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:05 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:06.113875 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-6d76d221-dd40-467b-ae31-e99ab2abef8a tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:06.116491 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-6d76d221-dd40-467b-ae31-e99ab2abef8a tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:06.121566 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6d76d221-dd40-467b-ae31-e99ab2abef8a tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:06.122020 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6d76d221-dd40-467b-ae31-e99ab2abef8a tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:06.123193 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6d76d221-dd40-467b-ae31-e99ab2abef8a tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:06.123552 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6d76d221-dd40-467b-ae31-e99ab2abef8a tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:06.333991 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-6d76d221-dd40-467b-ae31-e99ab2abef8a tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:06.342656 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-6d76d221-dd40-467b-ae31-e99ab2abef8a tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1576 microversion: 2.1 time: 0.238289 Jun 17 08:58:06.351545 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 442/877] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:06 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1576 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:06.658929 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-ea6a43fd-08fc-4774-b0cd-7cc9bc368bf9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:06.659800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-ea6a43fd-08fc-4774-b0cd-7cc9bc368bf9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:06.668011 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ea6a43fd-08fc-4774-b0cd-7cc9bc368bf9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:06.668753 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ea6a43fd-08fc-4774-b0cd-7cc9bc368bf9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:06.669971 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ea6a43fd-08fc-4774-b0cd-7cc9bc368bf9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:06.670421 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ea6a43fd-08fc-4774-b0cd-7cc9bc368bf9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:06.810481 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-bd996344-4225-453f-9147-7f07c9c1ce79 req-78cd4f56-2f7c-4717-aef8-aca9d70bbec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e32781c-7056-4c56-a02d-4c94cbc414f8", "name": "network-vif-plugged", "status": "completed", "tag": "3b983d08-82e5-4031-8c13-d190ca57fc87"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:58:06.825953 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-bd996344-4225-453f-9147-7f07c9c1ce79 req-78cd4f56-2f7c-4717-aef8-aca9d70bbec1 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:06.826464 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-bd996344-4225-453f-9147-7f07c9c1ce79 req-78cd4f56-2f7c-4717-aef8-aca9d70bbec1 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:06.839394 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-bd996344-4225-453f-9147-7f07c9c1ce79 req-78cd4f56-2f7c-4717-aef8-aca9d70bbec1 service nova] Creating event network-vif-plugged:3b983d08-82e5-4031-8c13-d190ca57fc87 for instance 8e32781c-7056-4c56-a02d-4c94cbc414f8 on hv-cinder-79760 Jun 17 08:58:06.844901 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-bd996344-4225-453f-9147-7f07c9c1ce79 req-78cd4f56-2f7c-4717-aef8-aca9d70bbec1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040540 Jun 17 08:58:06.845981 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 443/878] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:58:06.856282 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-ea6a43fd-08fc-4774-b0cd-7cc9bc368bf9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:06.865963 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-ea6a43fd-08fc-4774-b0cd-7cc9bc368bf9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:06.867713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-ea6a43fd-08fc-4774-b0cd-7cc9bc368bf9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:06.869033 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-ea6a43fd-08fc-4774-b0cd-7cc9bc368bf9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1738 microversion: 2.20 time: 0.216282 Jun 17 08:58:06.876147 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 436/879] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:06 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:07.358111 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=12 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:07.363557 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-bb485679-fb13-45d2-8182-3fc7735dd544 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:07.364272 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-bb485679-fb13-45d2-8182-3fc7735dd544 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:07.370662 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bb485679-fb13-45d2-8182-3fc7735dd544 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:07.371118 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bb485679-fb13-45d2-8182-3fc7735dd544 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:07.371927 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bb485679-fb13-45d2-8182-3fc7735dd544 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:07.372370 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bb485679-fb13-45d2-8182-3fc7735dd544 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:07.518688 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-bb485679-fb13-45d2-8182-3fc7735dd544 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:07.527887 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-bb485679-fb13-45d2-8182-3fc7735dd544 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1576 microversion: 2.1 time: 0.170288 Jun 17 08:58:07.528879 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 444/880] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:07 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:07.889650 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0f2f6101-d650-4a16-ba48-ca5b6d897e75 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:07.890343 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0f2f6101-d650-4a16-ba48-ca5b6d897e75 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:07.897462 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0f2f6101-d650-4a16-ba48-ca5b6d897e75 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:07.898011 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0f2f6101-d650-4a16-ba48-ca5b6d897e75 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:07.898871 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0f2f6101-d650-4a16-ba48-ca5b6d897e75 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:07.899702 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0f2f6101-d650-4a16-ba48-ca5b6d897e75 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:08.244499 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0f2f6101-d650-4a16-ba48-ca5b6d897e75 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:08.256809 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0f2f6101-d650-4a16-ba48-ca5b6d897e75 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:08.258600 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0f2f6101-d650-4a16-ba48-ca5b6d897e75 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:08.259945 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0f2f6101-d650-4a16-ba48-ca5b6d897e75 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1738 microversion: 2.20 time: 0.374346 Jun 17 08:58:08.270147 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 437/881] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:07 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1738 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:08.549997 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-5adfd4e0-5c75-4507-a3e7-88b264d46fb5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:08.550853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-5adfd4e0-5c75-4507-a3e7-88b264d46fb5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:08.558245 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5adfd4e0-5c75-4507-a3e7-88b264d46fb5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:08.559089 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5adfd4e0-5c75-4507-a3e7-88b264d46fb5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:08.561366 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5adfd4e0-5c75-4507-a3e7-88b264d46fb5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:08.562228 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5adfd4e0-5c75-4507-a3e7-88b264d46fb5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:08.711515 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-5adfd4e0-5c75-4507-a3e7-88b264d46fb5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:08.713811 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=100 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:08.721328 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-5adfd4e0-5c75-4507-a3e7-88b264d46fb5 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1576 microversion: 2.1 time: 0.175417 Jun 17 08:58:08.728605 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 445/882] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:08 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:09.280985 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-c2af219c-e848-4c0a-ae78-9c0a4f4d716b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:09.281667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-c2af219c-e848-4c0a-ae78-9c0a4f4d716b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:09.289498 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c2af219c-e848-4c0a-ae78-9c0a4f4d716b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:09.290063 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c2af219c-e848-4c0a-ae78-9c0a4f4d716b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:09.290909 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c2af219c-e848-4c0a-ae78-9c0a4f4d716b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:09.291447 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c2af219c-e848-4c0a-ae78-9c0a4f4d716b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:09.461793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c2af219c-e848-4c0a-ae78-9c0a4f4d716b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:09.472658 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c2af219c-e848-4c0a-ae78-9c0a4f4d716b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:09.474184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c2af219c-e848-4c0a-ae78-9c0a4f4d716b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:09.475887 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-c2af219c-e848-4c0a-ae78-9c0a4f4d716b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1738 microversion: 2.20 time: 0.198847 Jun 17 08:58:09.490485 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 438/883] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:09 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:09.746835 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-dce8e765-bee7-41cc-94b5-fb2d5d9b0d0a tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:09.748469 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-dce8e765-bee7-41cc-94b5-fb2d5d9b0d0a tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:09.758753 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dce8e765-bee7-41cc-94b5-fb2d5d9b0d0a tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:09.759668 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dce8e765-bee7-41cc-94b5-fb2d5d9b0d0a tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:09.760686 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dce8e765-bee7-41cc-94b5-fb2d5d9b0d0a tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:09.761341 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dce8e765-bee7-41cc-94b5-fb2d5d9b0d0a tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:09.968027 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-dce8e765-bee7-41cc-94b5-fb2d5d9b0d0a tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:09.976725 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-dce8e765-bee7-41cc-94b5-fb2d5d9b0d0a tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1576 microversion: 2.1 time: 0.233837 Jun 17 08:58:09.989389 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 446/884] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:09 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1576 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:10.496456 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0ace0a55-c817-4630-859f-077dbb63a65b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:10.497064 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0ace0a55-c817-4630-859f-077dbb63a65b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:10.503971 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0ace0a55-c817-4630-859f-077dbb63a65b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:10.504435 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0ace0a55-c817-4630-859f-077dbb63a65b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:10.505211 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0ace0a55-c817-4630-859f-077dbb63a65b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:10.505650 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0ace0a55-c817-4630-859f-077dbb63a65b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:10.578901 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-ae490786-7b58-4c8f-87d9-2510588a47ee tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:10.579784 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-ae490786-7b58-4c8f-87d9-2510588a47ee tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:10.586441 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ae490786-7b58-4c8f-87d9-2510588a47ee tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:10.586897 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ae490786-7b58-4c8f-87d9-2510588a47ee tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:10.587708 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ae490786-7b58-4c8f-87d9-2510588a47ee tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:10.588153 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ae490786-7b58-4c8f-87d9-2510588a47ee tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:10.655131 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0ace0a55-c817-4630-859f-077dbb63a65b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:10.664837 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0ace0a55-c817-4630-859f-077dbb63a65b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:10.666524 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0ace0a55-c817-4630-859f-077dbb63a65b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:10.667607 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0ace0a55-c817-4630-859f-077dbb63a65b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1738 microversion: 2.20 time: 0.175220 Jun 17 08:58:10.668170 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 439/885] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:10 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:10.687906 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.objects.instance [None req-ae490786-7b58-4c8f-87d9-2510588a47ee tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lazy-loading 'services' on Instance uuid 1eb89053-6d2e-47f4-a675-6254d182e074 {{(pid=129876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:58:10.993955 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-92689ac0-f8ac-4bcb-8ed2-b517d8fdd147 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:10.994589 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-92689ac0-f8ac-4bcb-8ed2-b517d8fdd147 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:11.001084 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-92689ac0-f8ac-4bcb-8ed2-b517d8fdd147 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:11.001583 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-92689ac0-f8ac-4bcb-8ed2-b517d8fdd147 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:11.002443 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-92689ac0-f8ac-4bcb-8ed2-b517d8fdd147 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:11.002897 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-92689ac0-f8ac-4bcb-8ed2-b517d8fdd147 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:11.139112 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-ae490786-7b58-4c8f-87d9-2510588a47ee tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074/os-volume_attachments/a40ed135-1a4e-456d-a5dd-1ce31dee8d66" status: 202 len: 0 microversion: 2.1 time: 0.563677 Jun 17 08:58:11.143637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 447/886] 10.222.0.78 () {58 vars in 1415 bytes} [Fri Jun 17 08:58:10 2022] DELETE /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074/os-volume_attachments/a40ed135-1a4e-456d-a5dd-1ce31dee8d66 => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 08:58:11.150238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-83c16f73-4287-41cf-90f4-5e094809328b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:11.151325 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-83c16f73-4287-41cf-90f4-5e094809328b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:11.160066 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-83c16f73-4287-41cf-90f4-5e094809328b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:11.160904 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-83c16f73-4287-41cf-90f4-5e094809328b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:11.161993 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-83c16f73-4287-41cf-90f4-5e094809328b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:11.162688 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-83c16f73-4287-41cf-90f4-5e094809328b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:11.164107 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-92689ac0-f8ac-4bcb-8ed2-b517d8fdd147 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:11.172360 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-92689ac0-f8ac-4bcb-8ed2-b517d8fdd147 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1563 microversion: 2.1 time: 0.182240 Jun 17 08:58:11.183971 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 440/887] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:10 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1563 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:58:11.203404 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-83c16f73-4287-41cf-90f4-5e094809328b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057841 Jun 17 08:58:11.204157 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 448/888] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 08:58:11 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:58:11.688183 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-01aa8349-7dbc-4447-8cca-96a1e1bc9fac tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:11.690059 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-01aa8349-7dbc-4447-8cca-96a1e1bc9fac tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:11.709404 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-01aa8349-7dbc-4447-8cca-96a1e1bc9fac tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:11.711849 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-01aa8349-7dbc-4447-8cca-96a1e1bc9fac tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:11.717156 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-01aa8349-7dbc-4447-8cca-96a1e1bc9fac tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:11.717763 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-01aa8349-7dbc-4447-8cca-96a1e1bc9fac tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:11.885556 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-01aa8349-7dbc-4447-8cca-96a1e1bc9fac tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:11.901385 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-01aa8349-7dbc-4447-8cca-96a1e1bc9fac tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:11.903810 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-01aa8349-7dbc-4447-8cca-96a1e1bc9fac tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:11.905919 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-01aa8349-7dbc-4447-8cca-96a1e1bc9fac tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1738 microversion: 2.20 time: 0.222814 Jun 17 08:58:11.907095 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 441/889] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:11 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:12.218994 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-c17ef50b-6eca-431f-bc8d-a0c277f1349f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:12.220434 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-c17ef50b-6eca-431f-bc8d-a0c277f1349f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:12.228784 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c17ef50b-6eca-431f-bc8d-a0c277f1349f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:12.229696 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c17ef50b-6eca-431f-bc8d-a0c277f1349f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:12.230760 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c17ef50b-6eca-431f-bc8d-a0c277f1349f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:12.231749 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c17ef50b-6eca-431f-bc8d-a0c277f1349f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:12.273076 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-c17ef50b-6eca-431f-bc8d-a0c277f1349f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059448 Jun 17 08:58:12.273830 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 449/890] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 08:58:12 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:58:12.926608 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a83ca46b-5896-4555-801f-4fb4500590ae tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:12.927273 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-a83ca46b-5896-4555-801f-4fb4500590ae tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:12.937528 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a83ca46b-5896-4555-801f-4fb4500590ae tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:12.942094 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a83ca46b-5896-4555-801f-4fb4500590ae tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:12.942094 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a83ca46b-5896-4555-801f-4fb4500590ae tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:12.942094 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a83ca46b-5896-4555-801f-4fb4500590ae tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:13.086736 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a83ca46b-5896-4555-801f-4fb4500590ae tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:13.095830 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a83ca46b-5896-4555-801f-4fb4500590ae tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:13.103266 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a83ca46b-5896-4555-801f-4fb4500590ae tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:13.103266 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-a83ca46b-5896-4555-801f-4fb4500590ae tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1738 microversion: 2.20 time: 0.176313 Jun 17 08:58:13.103266 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 442/891] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:12 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:13.286218 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-de7941cb-7580-45a0-b35a-fb54d441772b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:13.287200 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-de7941cb-7580-45a0-b35a-fb54d441772b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:13.294094 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-de7941cb-7580-45a0-b35a-fb54d441772b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:13.294452 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-de7941cb-7580-45a0-b35a-fb54d441772b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:13.295466 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-de7941cb-7580-45a0-b35a-fb54d441772b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:13.295919 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-de7941cb-7580-45a0-b35a-fb54d441772b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:13.327535 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-de7941cb-7580-45a0-b35a-fb54d441772b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046138 Jun 17 08:58:13.328092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 450/892] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 08:58:13 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 08:58:13.409929 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-75aa4be9-3fb8-4fcb-9c02-6ba311a3ad5e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:13.410851 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-75aa4be9-3fb8-4fcb-9c02-6ba311a3ad5e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:13.418498 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-75aa4be9-3fb8-4fcb-9c02-6ba311a3ad5e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:13.418961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-75aa4be9-3fb8-4fcb-9c02-6ba311a3ad5e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:13.419786 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-75aa4be9-3fb8-4fcb-9c02-6ba311a3ad5e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:13.420229 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-75aa4be9-3fb8-4fcb-9c02-6ba311a3ad5e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:13.453273 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-75aa4be9-3fb8-4fcb-9c02-6ba311a3ad5e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Going to try to terminate instance {{(pid=129875) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:58:13.567576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:13.756430 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-75aa4be9-3fb8-4fcb-9c02-6ba311a3ad5e tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 204 len: 0 microversion: 2.1 time: 0.351516 Jun 17 08:58:13.757029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 443/893] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 08:58:13 2022] DELETE /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:58:13.765285 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-41cee0bc-b8d4-4507-aa8f-bf1a448ea20a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:13.765897 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-41cee0bc-b8d4-4507-aa8f-bf1a448ea20a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:13.773694 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-41cee0bc-b8d4-4507-aa8f-bf1a448ea20a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:13.774346 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-41cee0bc-b8d4-4507-aa8f-bf1a448ea20a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:13.775389 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-41cee0bc-b8d4-4507-aa8f-bf1a448ea20a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:13.776141 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-41cee0bc-b8d4-4507-aa8f-bf1a448ea20a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:13.998036 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-41cee0bc-b8d4-4507-aa8f-bf1a448ea20a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:13.998036 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-41cee0bc-b8d4-4507-aa8f-bf1a448ea20a tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1689 microversion: 2.1 time: 0.166448 Jun 17 08:58:13.998036 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 451/894] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:13 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:14.118407 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-00366b70-1cc4-4695-8a57-b96967fc7c32 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:14.119461 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-00366b70-1cc4-4695-8a57-b96967fc7c32 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:14.126101 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-00366b70-1cc4-4695-8a57-b96967fc7c32 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:14.127147 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-00366b70-1cc4-4695-8a57-b96967fc7c32 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:14.128148 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-00366b70-1cc4-4695-8a57-b96967fc7c32 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:14.128592 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-00366b70-1cc4-4695-8a57-b96967fc7c32 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:14.260611 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-00366b70-1cc4-4695-8a57-b96967fc7c32 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:14.273134 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-00366b70-1cc4-4695-8a57-b96967fc7c32 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:14.274684 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-00366b70-1cc4-4695-8a57-b96967fc7c32 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:14.275982 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-00366b70-1cc4-4695-8a57-b96967fc7c32 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1738 microversion: 2.20 time: 0.161839 Jun 17 08:58:14.276553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 444/895] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:14 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:15.048057 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-41290c2e-dd4a-418a-9565-0d6a5b6e42d6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:15.049618 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-41290c2e-dd4a-418a-9565-0d6a5b6e42d6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:15.057074 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-41290c2e-dd4a-418a-9565-0d6a5b6e42d6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:15.057544 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-41290c2e-dd4a-418a-9565-0d6a5b6e42d6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:15.058297 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-41290c2e-dd4a-418a-9565-0d6a5b6e42d6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:15.058736 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-41290c2e-dd4a-418a-9565-0d6a5b6e42d6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:15.199083 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-41290c2e-dd4a-418a-9565-0d6a5b6e42d6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:15.207053 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-41290c2e-dd4a-418a-9565-0d6a5b6e42d6 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1689 microversion: 2.1 time: 0.265568 Jun 17 08:58:15.207693 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 452/896] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:14 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1689 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:15.294291 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-b415d346-0a02-4de1-8fb6-ca2790ed3c8a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:15.299216 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-b415d346-0a02-4de1-8fb6-ca2790ed3c8a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:15.302331 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b415d346-0a02-4de1-8fb6-ca2790ed3c8a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:15.302789 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b415d346-0a02-4de1-8fb6-ca2790ed3c8a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:15.303617 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b415d346-0a02-4de1-8fb6-ca2790ed3c8a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:15.304058 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b415d346-0a02-4de1-8fb6-ca2790ed3c8a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:15.437177 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b415d346-0a02-4de1-8fb6-ca2790ed3c8a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:15.445476 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b415d346-0a02-4de1-8fb6-ca2790ed3c8a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:15.446996 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b415d346-0a02-4de1-8fb6-ca2790ed3c8a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:15.448227 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-b415d346-0a02-4de1-8fb6-ca2790ed3c8a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1738 microversion: 2.20 time: 0.158033 Jun 17 08:58:15.448789 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 445/897] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:15 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:16.224544 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-7ddfe0a2-a890-4401-9e98-7fba20c471b3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:16.225078 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-7ddfe0a2-a890-4401-9e98-7fba20c471b3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:16.231669 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7ddfe0a2-a890-4401-9e98-7fba20c471b3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:16.232124 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7ddfe0a2-a890-4401-9e98-7fba20c471b3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:16.232884 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7ddfe0a2-a890-4401-9e98-7fba20c471b3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:16.233323 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7ddfe0a2-a890-4401-9e98-7fba20c471b3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:16.369835 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-7ddfe0a2-a890-4401-9e98-7fba20c471b3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:16.377696 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-7ddfe0a2-a890-4401-9e98-7fba20c471b3 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1689 microversion: 2.1 time: 0.157142 Jun 17 08:58:16.378279 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 453/898] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:16 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:16.467294 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-913ce65a-8f7d-4b48-8080-19216a8305b6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:16.467999 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-913ce65a-8f7d-4b48-8080-19216a8305b6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:16.475742 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-913ce65a-8f7d-4b48-8080-19216a8305b6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:16.476187 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-913ce65a-8f7d-4b48-8080-19216a8305b6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:16.476987 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-913ce65a-8f7d-4b48-8080-19216a8305b6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:16.477450 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-913ce65a-8f7d-4b48-8080-19216a8305b6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:16.607210 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-913ce65a-8f7d-4b48-8080-19216a8305b6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:16.616229 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-913ce65a-8f7d-4b48-8080-19216a8305b6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:16.617729 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-913ce65a-8f7d-4b48-8080-19216a8305b6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:16.618896 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-913ce65a-8f7d-4b48-8080-19216a8305b6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1738 microversion: 2.20 time: 0.155629 Jun 17 08:58:16.619486 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 446/899] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:16 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:17.400797 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-6697e810-0d04-4916-b19d-63bc710617a8 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:17.401887 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-6697e810-0d04-4916-b19d-63bc710617a8 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:17.409526 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6697e810-0d04-4916-b19d-63bc710617a8 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:17.409979 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6697e810-0d04-4916-b19d-63bc710617a8 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:17.410745 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6697e810-0d04-4916-b19d-63bc710617a8 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:17.411183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6697e810-0d04-4916-b19d-63bc710617a8 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:17.549278 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-6697e810-0d04-4916-b19d-63bc710617a8 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:17.557365 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-6697e810-0d04-4916-b19d-63bc710617a8 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1689 microversion: 2.1 time: 0.163894 Jun 17 08:58:17.557977 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 454/900] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:17 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:17.637083 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-c13d0a91-d528-44e4-954f-e8a59ec60814 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:17.637691 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-c13d0a91-d528-44e4-954f-e8a59ec60814 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:17.644874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c13d0a91-d528-44e4-954f-e8a59ec60814 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:17.645322 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c13d0a91-d528-44e4-954f-e8a59ec60814 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:17.646088 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c13d0a91-d528-44e4-954f-e8a59ec60814 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:17.646526 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c13d0a91-d528-44e4-954f-e8a59ec60814 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:17.785635 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c13d0a91-d528-44e4-954f-e8a59ec60814 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:17.793842 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c13d0a91-d528-44e4-954f-e8a59ec60814 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:17.795261 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c13d0a91-d528-44e4-954f-e8a59ec60814 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:17.797328 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-c13d0a91-d528-44e4-954f-e8a59ec60814 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1738 microversion: 2.20 time: 0.163518 Jun 17 08:58:17.797328 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 447/901] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:17 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:18.223612 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-868a7d83-21f7-42e6-85df-680b37af6e65 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-39304678", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-899283893", "security_groups": [{"name": "tempest-secgroup-smoke-926804049"}], "block_device_mapping_v2": [{"uuid": "62268ed6-46dd-41fc-9c9d-aa005b7bc9c2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "131209d2-1a19-4f69-ac13-17a3bc0e6ba1"}]}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:58:18.406328 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.network.neutron [None req-868a7d83-21f7-42e6-85df-680b37af6e65 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] validate_networks() for [('131209d2-1a19-4f69-ac13-17a3bc0e6ba1', None, None, None, None, None)] {{(pid=129876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:58:18.575336 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-683c08a6-bf79-4c14-ab7e-38a184a3fb94 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:18.576248 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-683c08a6-bf79-4c14-ab7e-38a184a3fb94 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:18.584226 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-683c08a6-bf79-4c14-ab7e-38a184a3fb94 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:18.584808 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-683c08a6-bf79-4c14-ab7e-38a184a3fb94 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:18.585685 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-683c08a6-bf79-4c14-ab7e-38a184a3fb94 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:18.586431 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-683c08a6-bf79-4c14-ab7e-38a184a3fb94 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:18.881493 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-683c08a6-bf79-4c14-ab7e-38a184a3fb94 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:18.889465 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-683c08a6-bf79-4c14-ab7e-38a184a3fb94 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1689 microversion: 2.1 time: 0.318136 Jun 17 08:58:18.890058 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 448/902] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:18 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1689 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:58:18.894752 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3cf0e2ca-0c97-4523-85e9-122628a9c47b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:18.896777 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-3cf0e2ca-0c97-4523-85e9-122628a9c47b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:18.901521 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3cf0e2ca-0c97-4523-85e9-122628a9c47b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:18.901963 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3cf0e2ca-0c97-4523-85e9-122628a9c47b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:18.902769 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3cf0e2ca-0c97-4523-85e9-122628a9c47b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:18.903200 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3cf0e2ca-0c97-4523-85e9-122628a9c47b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:19.151072 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3cf0e2ca-0c97-4523-85e9-122628a9c47b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:19.160491 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3cf0e2ca-0c97-4523-85e9-122628a9c47b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:19.162015 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3cf0e2ca-0c97-4523-85e9-122628a9c47b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:19.163217 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-3cf0e2ca-0c97-4523-85e9-122628a9c47b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1720 microversion: 2.20 time: 0.272244 Jun 17 08:58:19.163810 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 449/903] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:18 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1720 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:19.246440 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-868a7d83-21f7-42e6-85df-680b37af6e65 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Flavor limits 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:58:19.247280 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-868a7d83-21f7-42e6-85df-680b37af6e65 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Image limits 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:58:19.247854 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-868a7d83-21f7-42e6-85df-680b37af6e65 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Flavor pref 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:58:19.248348 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-868a7d83-21f7-42e6-85df-680b37af6e65 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Image pref 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:58:19.249006 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-868a7d83-21f7-42e6-85df-680b37af6e65 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:58:19.258528 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-868a7d83-21f7-42e6-85df-680b37af6e65 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:19.259025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-868a7d83-21f7-42e6-85df-680b37af6e65 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:19.260001 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-868a7d83-21f7-42e6-85df-680b37af6e65 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:19.265627 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-868a7d83-21f7-42e6-85df-680b37af6e65 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:19.279687 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-868a7d83-21f7-42e6-85df-680b37af6e65 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Getting quotas for project 4c3ecf1efb8748a0af09e501e2b9d81b. Resources: {'ram', 'cores', 'instances'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:58:19.284473 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-868a7d83-21f7-42e6-85df-680b37af6e65 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Getting quotas for user 61c06d41d371486c9856a17c5b2aee20 and project 4c3ecf1efb8748a0af09e501e2b9d81b. Resources: {'ram', 'cores', 'instances'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:58:19.333451 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-ab42de4b-6724-4ac8-9503-5c695ea9425e req-db3ed285-dd04-4953-bffb-24f481cab176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb89053-6d2e-47f4-a675-6254d182e074", "name": "network-vif-deleted", "tag": "b987fec9-a409-4d3b-a983-64e04e498d92"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:58:19.342774 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-ab42de4b-6724-4ac8-9503-5c695ea9425e req-db3ed285-dd04-4953-bffb-24f481cab176 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:19.345809 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-ab42de4b-6724-4ac8-9503-5c695ea9425e req-db3ed285-dd04-4953-bffb-24f481cab176 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:19.355388 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-868a7d83-21f7-42e6-85df-680b37af6e65 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Going to run 1 instances... {{(pid=129876) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:58:19.357700 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-868a7d83-21f7-42e6-85df-680b37af6e65 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='62268ed6-46dd-41fc-9c9d-aa005b7bc9c2',volume_size=None,volume_type=None)] {{(pid=129876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:58:19.359554 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-ab42de4b-6724-4ac8-9503-5c695ea9425e req-db3ed285-dd04-4953-bffb-24f481cab176 service nova] Creating event network-vif-deleted:b987fec9-a409-4d3b-a983-64e04e498d92 for instance 1eb89053-6d2e-47f4-a675-6254d182e074 on hv-cinder-79760 Jun 17 08:58:19.365741 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-ab42de4b-6724-4ac8-9503-5c695ea9425e req-db3ed285-dd04-4953-bffb-24f481cab176 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036364 Jun 17 08:58:19.366640 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 450/904] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:58:19.758416 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-868a7d83-21f7-42e6-85df-680b37af6e65 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.538712 Jun 17 08:58:19.764163 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 455/905] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jun 17 08:58:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 1545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:58:19.771057 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-f0317910-b5d9-46c0-a8a5-4c751f4e0a67 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:19.771837 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-f0317910-b5d9-46c0-a8a5-4c751f4e0a67 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:19.776445 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:19.846071 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f0317910-b5d9-46c0-a8a5-4c751f4e0a67 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:19.853202 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-f0317910-b5d9-46c0-a8a5-4c751f4e0a67 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1092 microversion: 2.1 time: 0.087428 Jun 17 08:58:19.863934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 451/906] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:19 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1092 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:19.907216 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-3ce98078-1229-4091-9bf2-efca23be008c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:19.908400 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-3ce98078-1229-4091-9bf2-efca23be008c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:19.915166 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3ce98078-1229-4091-9bf2-efca23be008c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:19.915644 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3ce98078-1229-4091-9bf2-efca23be008c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:19.916420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3ce98078-1229-4091-9bf2-efca23be008c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:19.916854 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3ce98078-1229-4091-9bf2-efca23be008c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:19.985982 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-3ce98078-1229-4091-9bf2-efca23be008c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:19.994602 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-3ce98078-1229-4091-9bf2-efca23be008c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1622 microversion: 2.1 time: 0.091128 Jun 17 08:58:19.995189 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 456/907] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:19 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1622 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:20.185253 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-5b166098-bf9d-4c35-92be-1412368c4d37 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:20.185783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-5b166098-bf9d-4c35-92be-1412368c4d37 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:20.195333 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5b166098-bf9d-4c35-92be-1412368c4d37 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:20.195822 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5b166098-bf9d-4c35-92be-1412368c4d37 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:20.196598 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5b166098-bf9d-4c35-92be-1412368c4d37 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:20.197147 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5b166098-bf9d-4c35-92be-1412368c4d37 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:20.357396 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-5b166098-bf9d-4c35-92be-1412368c4d37 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:20.366448 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-5b166098-bf9d-4c35-92be-1412368c4d37 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:20.368027 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-5b166098-bf9d-4c35-92be-1412368c4d37 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:20.369197 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-5b166098-bf9d-4c35-92be-1412368c4d37 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1720 microversion: 2.20 time: 0.189974 Jun 17 08:58:20.369753 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 452/908] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:20 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1720 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:58:20.872593 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-52630c94-9fc1-49c5-a98b-f99cb923a401 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:20.873140 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-52630c94-9fc1-49c5-a98b-f99cb923a401 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:20.880973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-52630c94-9fc1-49c5-a98b-f99cb923a401 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:20.881438 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-52630c94-9fc1-49c5-a98b-f99cb923a401 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:20.882264 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-52630c94-9fc1-49c5-a98b-f99cb923a401 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:20.882731 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-52630c94-9fc1-49c5-a98b-f99cb923a401 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:20.948476 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-52630c94-9fc1-49c5-a98b-f99cb923a401 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:20.958008 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-52630c94-9fc1-49c5-a98b-f99cb923a401 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1142 microversion: 2.1 time: 0.089239 Jun 17 08:58:20.958624 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 457/909] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:20 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1142 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:21.014020 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-5eb3758c-1898-4e67-a296-9564795f1386 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:21.014641 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-5eb3758c-1898-4e67-a296-9564795f1386 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:21.023659 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5eb3758c-1898-4e67-a296-9564795f1386 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:21.024194 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5eb3758c-1898-4e67-a296-9564795f1386 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:21.025040 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5eb3758c-1898-4e67-a296-9564795f1386 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:21.026249 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5eb3758c-1898-4e67-a296-9564795f1386 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:21.058984 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5eb3758c-1898-4e67-a296-9564795f1386 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:21.059475 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5eb3758c-1898-4e67-a296-9564795f1386 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:21.059934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-5eb3758c-1898-4e67-a296-9564795f1386 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lazy-loading 'fault' on Instance uuid 1eb89053-6d2e-47f4-a675-6254d182e074 {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:58:21.103852 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-5eb3758c-1898-4e67-a296-9564795f1386 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:21.111496 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-5eb3758c-1898-4e67-a296-9564795f1386 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 200 len: 1335 microversion: 2.1 time: 0.101318 Jun 17 08:58:21.112084 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 453/910] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:21 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 1335 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:21.387986 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-60f041ca-9643-4843-9dc3-d1880f7ce12d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:21.389074 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-60f041ca-9643-4843-9dc3-d1880f7ce12d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:21.395992 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-60f041ca-9643-4843-9dc3-d1880f7ce12d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:21.396523 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-60f041ca-9643-4843-9dc3-d1880f7ce12d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:21.397365 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-60f041ca-9643-4843-9dc3-d1880f7ce12d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:21.397878 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-60f041ca-9643-4843-9dc3-d1880f7ce12d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:21.532575 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-60f041ca-9643-4843-9dc3-d1880f7ce12d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:21.541067 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-60f041ca-9643-4843-9dc3-d1880f7ce12d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:21.542950 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-60f041ca-9643-4843-9dc3-d1880f7ce12d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:21.544166 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-60f041ca-9643-4843-9dc3-d1880f7ce12d tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1723 microversion: 2.20 time: 0.160267 Jun 17 08:58:21.550926 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 458/911] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:21 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:21.566809 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-96f0ec71-49de-4052-8773-608eb850efed tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4cc4f4cb-165f-49cd-bd39-e104a29f47e4"}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:58:21.568719 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-96f0ec71-49de-4052-8773-608eb850efed tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:21.575475 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-96f0ec71-49de-4052-8773-608eb850efed tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:21.575934 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-96f0ec71-49de-4052-8773-608eb850efed tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:21.576840 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-96f0ec71-49de-4052-8773-608eb850efed tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:21.577283 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-96f0ec71-49de-4052-8773-608eb850efed tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:21.978097 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-665aa80d-0338-47a9-a68d-d1afa14c072e tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:21.978803 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-665aa80d-0338-47a9-a68d-d1afa14c072e tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:21.987259 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-665aa80d-0338-47a9-a68d-d1afa14c072e tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:21.987849 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-665aa80d-0338-47a9-a68d-d1afa14c072e tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:21.988724 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-665aa80d-0338-47a9-a68d-d1afa14c072e tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:21.989171 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-665aa80d-0338-47a9-a68d-d1afa14c072e tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:22.064486 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-665aa80d-0338-47a9-a68d-d1afa14c072e tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:22.072556 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-665aa80d-0338-47a9-a68d-d1afa14c072e tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1190 microversion: 2.1 time: 0.098305 Jun 17 08:58:22.073145 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 459/912] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:21 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1190 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:22.128981 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-5843bc81-9b69-42dc-9756-5a952617f632 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:22.129597 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-5843bc81-9b69-42dc-9756-5a952617f632 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 1eb89053-6d2e-47f4-a675-6254d182e074] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:22.136217 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5843bc81-9b69-42dc-9756-5a952617f632 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:22.136678 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5843bc81-9b69-42dc-9756-5a952617f632 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:22.137455 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5843bc81-9b69-42dc-9756-5a952617f632 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:22.137891 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5843bc81-9b69-42dc-9756-5a952617f632 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:22.152317 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-5843bc81-9b69-42dc-9756-5a952617f632 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] HTTP exception thrown: Instance 1eb89053-6d2e-47f4-a675-6254d182e074 could not be found. Jun 17 08:58:22.154052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-5843bc81-9b69-42dc-9756-5a952617f632 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Request method failure captured: Jun 17 08:58:22.154052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 HTTP/1.1 Jun 17 08:58:22.154052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:58:22.154052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:58:22.154052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:58:22.154052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 08:58:22.154052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:58:22.154052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:58:22.154052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:58:22.154052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:58:22.154052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirED5Euje8Qg466HZfzI6zCL6KuGF5BH7fLi2Pmi8ij3gYtPI6C-73btuLA8X2nSXoPf1noq4TUDtlOwCduBS9xL7_px9uXygULPkVYrbJQFD3qLcxvxV0BbEkrPf4s4e0iVeOxxYopv4Knn2YUw0jM9QPTqum78gRvcAfDjXtIdH9hY Jun 17 08:58:22.154052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:58:22.154052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:58:22.154052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:58:22.154052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:58:22.154052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:58:22.154052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:58:22.154052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: 6cd5b6aa6edd4bafa8aec3e9d28ae980 Jun 17 08:58:22.154052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1528519624 Jun 17 08:58:22.154052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:58:22.154052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:58:22.155886 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6cd5b6aa6edd4bafa8aec3e9d28ae980"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6cd5b6aa6edd4bafa8aec3e9d28ae980"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6cd5b6aa6edd4bafa8aec3e9d28ae980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6cd5b6aa6edd4bafa8aec3e9d28ae980"}]}] Jun 17 08:58:22.155886 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1528519624 Jun 17 08:58:22.155886 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: 6cd5b6aa6edd4bafa8aec3e9d28ae980 Jun 17 08:58:22.155886 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1528519624 Jun 17 08:58:22.155886 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-ServerRescueNegativeTestJSON-1528519624-project Jun 17 08:58:22.155886 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:58:22.155886 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:58:22.155886 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: 5e4214dbd10d491eb6afa50321edca88 Jun 17 08:58:22.155886 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1528519624-project Jun 17 08:58:22.155886 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 08:58:22.155886 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Instance 1eb89053-6d2e-47f4-a675-6254d182e074 could not be found. Jun 17 08:58:22.155886 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'id': '1eb89053-6d2e-47f4-a675-6254d182e074'} Jun 17 08:58:22.156824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:58:22.156824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:58:22.156824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:58:22.156824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:58:22.156824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:58:22.156824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:58:22.156824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:58:22.156824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:58:22.156824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:58:22.156824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:58:22.156824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eb89053-6d2e-47f4-a675-6254d182e074 could not be found. Jun 17 08:58:22.156824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:58:22.156824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:58:22.156824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:58:22.156824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:58:22.156824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:58:22.156824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:58:22.156824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:58:22.156824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:58:22.156824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:58:22.159219 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:58:22.159219 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:58:22.159219 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:58:22.159219 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:58:22.159219 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:58:22.159219 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:58:22.159219 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:58:22.159219 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eb89053-6d2e-47f4-a675-6254d182e074 could not be found. Jun 17 08:58:22.159219 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:58:22.159219 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:58:22.159219 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:58:22.159219 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:58:22.159219 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:58:22.159219 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:58:22.159219 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:58:22.159219 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:58:22.159219 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eb89053-6d2e-47f4-a675-6254d182e074 could not be found. Jun 17 08:58:22.159219 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:58:22.160437 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-5843bc81-9b69-42dc-9756-5a952617f632 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Returning 404 to user: Instance 1eb89053-6d2e-47f4-a675-6254d182e074 could not be found. {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:58:22.160437 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-5843bc81-9b69-42dc-9756-5a952617f632 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074" status: 404 len: 111 microversion: 2.1 time: 0.030534 Jun 17 08:58:22.160437 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 460/913] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:22 2022] GET /compute/v2.1/servers/1eb89053-6d2e-47f4-a675-6254d182e074 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 08:58:22.165290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-dbdca623-b1ed-496b-afe5-c3b77539e1db tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '.version_select at 0x7fbc44379ca0>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:22.245762 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-dbdca623-b1ed-496b-afe5-c3b77539e1db tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-433164063" status: 202 len: 0 microversion: 2.1 time: 0.083945 Jun 17 08:58:22.250578 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 461/914] 10.222.0.78 () {58 vars in 1217 bytes} [Fri Jun 17 08:58:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-433164063 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:58:22.407940 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-af1ce1dc-4be6-406c-82de-d0f5f149d2b3 req-7dd6a5ce-f882-4043-8311-8807ea13dbe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b18a4b5-273d-4ec1-81a8-ca670de385ea", "name": "network-vif-unplugged", "status": "completed", "tag": "02d2e50f-49e7-4067-86ed-da24c07d5aea"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:58:22.419534 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-af1ce1dc-4be6-406c-82de-d0f5f149d2b3 req-7dd6a5ce-f882-4043-8311-8807ea13dbe1 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:22.420088 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-af1ce1dc-4be6-406c-82de-d0f5f149d2b3 req-7dd6a5ce-f882-4043-8311-8807ea13dbe1 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:22.434267 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.compute.server_external_events [req-af1ce1dc-4be6-406c-82de-d0f5f149d2b3 req-7dd6a5ce-f882-4043-8311-8807ea13dbe1 service nova] Unable to find a host for instance 2b18a4b5-273d-4ec1-81a8-ca670de385ea. Dropping event network-vif-unplugged {{(pid=129876) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 17 08:58:22.435178 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-af1ce1dc-4be6-406c-82de-d0f5f149d2b3 req-7dd6a5ce-f882-4043-8311-8807ea13dbe1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038223 Jun 17 08:58:22.436094 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 462/915] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 17 08:58:22.652817 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-96f0ec71-49de-4052-8773-608eb850efed tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "POST /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.090842 Jun 17 08:58:22.653773 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 454/916] 10.222.0.78 () {62 vars in 1363 bytes} [Fri Jun 17 08:58:21 2022] POST /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea/os-volume_attachments => generated 188 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:58:22.788271 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-f2adabcd-a82d-44b4-8b09-54aed2e4f02b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:22.789115 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-f2adabcd-a82d-44b4-8b09-54aed2e4f02b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:22.796562 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f2adabcd-a82d-44b4-8b09-54aed2e4f02b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:22.797106 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f2adabcd-a82d-44b4-8b09-54aed2e4f02b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:22.798761 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f2adabcd-a82d-44b4-8b09-54aed2e4f02b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:22.799272 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f2adabcd-a82d-44b4-8b09-54aed2e4f02b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:22.985782 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:23.090185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-ec52d0bf-14a4-4afe-8755-527ef744f14c tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:23.090804 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-ec52d0bf-14a4-4afe-8755-527ef744f14c tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:23.100246 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ec52d0bf-14a4-4afe-8755-527ef744f14c tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:23.100714 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ec52d0bf-14a4-4afe-8755-527ef744f14c tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:23.101864 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ec52d0bf-14a4-4afe-8755-527ef744f14c tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:23.102453 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ec52d0bf-14a4-4afe-8755-527ef744f14c tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:23.193062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-ec52d0bf-14a4-4afe-8755-527ef744f14c tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:23.200973 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-ec52d0bf-14a4-4afe-8755-527ef744f14c tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1208 microversion: 2.1 time: 0.114596 Jun 17 08:58:23.201569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 455/917] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:23 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1208 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:58:23.420004 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-f2adabcd-a82d-44b4-8b09-54aed2e4f02b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea/os-volume_attachments/4cc4f4cb-165f-49cd-bd39-e104a29f47e4" status: 202 len: 0 microversion: 2.20 time: 0.637291 Jun 17 08:58:23.436735 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 463/918] 10.222.0.78 () {60 vars in 1456 bytes} [Fri Jun 17 08:58:22 2022] DELETE /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea/os-volume_attachments/4cc4f4cb-165f-49cd-bd39-e104a29f47e4 => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 17 08:58:23.511092 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-db1da82d-6139-4a40-8f41-6f5d894ff88c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:58:23.511822 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-db1da82d-6139-4a40-8f41-6f5d894ff88c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:23.520916 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-db1da82d-6139-4a40-8f41-6f5d894ff88c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:23.521677 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-db1da82d-6139-4a40-8f41-6f5d894ff88c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:23.522594 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-db1da82d-6139-4a40-8f41-6f5d894ff88c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:23.523209 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-db1da82d-6139-4a40-8f41-6f5d894ff88c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:23.736029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-db1da82d-6139-4a40-8f41-6f5d894ff88c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "POST /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea/action" status: 202 len: 0 microversion: 2.20 time: 0.231879 Jun 17 08:58:23.737277 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 456/919] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jun 17 08:58:23 2022] POST /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:58:23.745446 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-5061407b-cced-44ad-9655-49aa7fdfef23 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:23.746064 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-5061407b-cced-44ad-9655-49aa7fdfef23 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:23.753849 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5061407b-cced-44ad-9655-49aa7fdfef23 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:23.754320 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5061407b-cced-44ad-9655-49aa7fdfef23 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:23.755279 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5061407b-cced-44ad-9655-49aa7fdfef23 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:23.755748 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5061407b-cced-44ad-9655-49aa7fdfef23 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:23.962762 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-5061407b-cced-44ad-9655-49aa7fdfef23 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:23.971893 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-5061407b-cced-44ad-9655-49aa7fdfef23 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:23.973405 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-5061407b-cced-44ad-9655-49aa7fdfef23 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:23.974762 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-5061407b-cced-44ad-9655-49aa7fdfef23 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1671 microversion: 2.20 time: 0.233106 Jun 17 08:58:23.975149 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 464/920] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:23 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1671 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:24.223614 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-58b620bb-1848-475e-ab4b-8c5ee99405d7 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:24.224623 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-58b620bb-1848-475e-ab4b-8c5ee99405d7 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:24.234496 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-58b620bb-1848-475e-ab4b-8c5ee99405d7 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:24.235391 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-58b620bb-1848-475e-ab4b-8c5ee99405d7 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:24.238171 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-58b620bb-1848-475e-ab4b-8c5ee99405d7 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:24.239051 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-58b620bb-1848-475e-ab4b-8c5ee99405d7 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:24.442727 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-58b620bb-1848-475e-ab4b-8c5ee99405d7 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:24.450664 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-58b620bb-1848-475e-ab4b-8c5ee99405d7 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1263 microversion: 2.1 time: 0.233280 Jun 17 08:58:24.452780 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 457/921] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:24 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1263 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:24.513081 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-5b583b7f-af19-4573-a5c0-e2737a581181 req-8f265e58-82ba-4132-af6c-757de690414e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ba9b8cb-042a-41e7-a0bf-2f511d8a685a", "tag": "1e938f08-b678-482d-a29c-cf7d85d201ba"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:58:24.520007 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:24.524742 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-5b583b7f-af19-4573-a5c0-e2737a581181 req-8f265e58-82ba-4132-af6c-757de690414e service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:24.525393 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-5b583b7f-af19-4573-a5c0-e2737a581181 req-8f265e58-82ba-4132-af6c-757de690414e service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:24.538269 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-5b583b7f-af19-4573-a5c0-e2737a581181 req-8f265e58-82ba-4132-af6c-757de690414e service nova] Creating event network-changed:1e938f08-b678-482d-a29c-cf7d85d201ba for instance 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a on hv-cinder-79760 Jun 17 08:58:24.545508 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-5b583b7f-af19-4573-a5c0-e2737a581181 req-8f265e58-82ba-4132-af6c-757de690414e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036377 Jun 17 08:58:24.546131 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 465/922] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:58:24.993108 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-fdbef739-1bba-4f57-befd-622b18054006 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:24.993726 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-fdbef739-1bba-4f57-befd-622b18054006 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:24.999954 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fdbef739-1bba-4f57-befd-622b18054006 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:25.000401 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fdbef739-1bba-4f57-befd-622b18054006 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:25.001187 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fdbef739-1bba-4f57-befd-622b18054006 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:25.001622 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fdbef739-1bba-4f57-befd-622b18054006 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:25.004408 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:INSERT=5,nova_cell1:SELECT=90,nova_cell1:UPDATE=5 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:25.227738 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-fdbef739-1bba-4f57-befd-622b18054006 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:25.236186 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-fdbef739-1bba-4f57-befd-622b18054006 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:25.237863 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-fdbef739-1bba-4f57-befd-622b18054006 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:25.239232 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-fdbef739-1bba-4f57-befd-622b18054006 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1671 microversion: 2.20 time: 0.250081 Jun 17 08:58:25.242044 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 458/923] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:24 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1671 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:25.477044 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-5031dda7-d67b-458f-b59c-bafe10071135 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:25.477900 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-5031dda7-d67b-458f-b59c-bafe10071135 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:25.485307 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5031dda7-d67b-458f-b59c-bafe10071135 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:25.485781 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5031dda7-d67b-458f-b59c-bafe10071135 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:25.486607 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5031dda7-d67b-458f-b59c-bafe10071135 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:25.487046 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5031dda7-d67b-458f-b59c-bafe10071135 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:25.627605 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-5031dda7-d67b-458f-b59c-bafe10071135 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:25.634993 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-5031dda7-d67b-458f-b59c-bafe10071135 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1263 microversion: 2.1 time: 0.162825 Jun 17 08:58:25.635586 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 466/924] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:25 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:25.827573 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-c4087340-aba4-4320-b1fa-f2ae247c9df4 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:25.828077 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-c4087340-aba4-4320-b1fa-f2ae247c9df4 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:25.834799 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c4087340-aba4-4320-b1fa-f2ae247c9df4 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:25.835246 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c4087340-aba4-4320-b1fa-f2ae247c9df4 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:25.836056 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c4087340-aba4-4320-b1fa-f2ae247c9df4 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:25.836493 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c4087340-aba4-4320-b1fa-f2ae247c9df4 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:25.862615 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-c4087340-aba4-4320-b1fa-f2ae247c9df4 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Going to try to terminate instance {{(pid=129875) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:58:26.070293 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-c4087340-aba4-4320-b1fa-f2ae247c9df4 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "DELETE /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 204 len: 0 microversion: 2.1 time: 0.246360 Jun 17 08:58:26.071206 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 459/925] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 08:58:25 2022] DELETE /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:58:26.086738 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-de397597-f3fd-400e-a686-75c79e198150 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:26.087377 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-de397597-f3fd-400e-a686-75c79e198150 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:26.093724 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-de397597-f3fd-400e-a686-75c79e198150 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:26.094181 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-de397597-f3fd-400e-a686-75c79e198150 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:26.094959 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-de397597-f3fd-400e-a686-75c79e198150 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:26.095436 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-de397597-f3fd-400e-a686-75c79e198150 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:26.259029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-c1a9cb45-f667-4ec9-ae82-281c9bb06053 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:26.259776 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-c1a9cb45-f667-4ec9-ae82-281c9bb06053 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:26.266437 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c1a9cb45-f667-4ec9-ae82-281c9bb06053 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:26.267131 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c1a9cb45-f667-4ec9-ae82-281c9bb06053 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:26.267945 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c1a9cb45-f667-4ec9-ae82-281c9bb06053 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:26.268432 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c1a9cb45-f667-4ec9-ae82-281c9bb06053 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:26.457929 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-de397597-f3fd-400e-a686-75c79e198150 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:26.464892 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c1a9cb45-f667-4ec9-ae82-281c9bb06053 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:26.465679 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-de397597-f3fd-400e-a686-75c79e198150 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1507 microversion: 2.1 time: 0.382883 Jun 17 08:58:26.466263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 467/926] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:26 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1507 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:26.473330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c1a9cb45-f667-4ec9-ae82-281c9bb06053 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:26.475036 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c1a9cb45-f667-4ec9-ae82-281c9bb06053 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:26.476312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-c1a9cb45-f667-4ec9-ae82-281c9bb06053 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1729 microversion: 2.20 time: 0.221603 Jun 17 08:58:26.476877 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 460/927] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:26 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1729 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:58:26.652258 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-8ffd0722-fbec-43d3-ac7d-c47bec7d34e4 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:26.652785 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-8ffd0722-fbec-43d3-ac7d-c47bec7d34e4 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:26.659266 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8ffd0722-fbec-43d3-ac7d-c47bec7d34e4 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:26.659754 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8ffd0722-fbec-43d3-ac7d-c47bec7d34e4 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:26.660538 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8ffd0722-fbec-43d3-ac7d-c47bec7d34e4 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:26.660970 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8ffd0722-fbec-43d3-ac7d-c47bec7d34e4 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:26.789648 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-8ffd0722-fbec-43d3-ac7d-c47bec7d34e4 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:26.797063 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-8ffd0722-fbec-43d3-ac7d-c47bec7d34e4 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1263 microversion: 2.1 time: 0.148771 Jun 17 08:58:26.798201 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 468/928] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:26 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:27.483022 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-22eca5be-4b46-48d8-ac8b-a1b8e6ba4f9b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:27.483670 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-22eca5be-4b46-48d8-ac8b-a1b8e6ba4f9b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:27.490370 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-22eca5be-4b46-48d8-ac8b-a1b8e6ba4f9b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:27.490825 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-22eca5be-4b46-48d8-ac8b-a1b8e6ba4f9b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:27.491631 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-22eca5be-4b46-48d8-ac8b-a1b8e6ba4f9b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:27.492076 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-22eca5be-4b46-48d8-ac8b-a1b8e6ba4f9b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:27.493991 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-12855f3f-3f3d-4afa-92aa-adc790d99f6f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:27.494603 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-12855f3f-3f3d-4afa-92aa-adc790d99f6f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:27.500530 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-12855f3f-3f3d-4afa-92aa-adc790d99f6f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:27.501123 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-12855f3f-3f3d-4afa-92aa-adc790d99f6f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:27.501933 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-12855f3f-3f3d-4afa-92aa-adc790d99f6f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:27.502371 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-12855f3f-3f3d-4afa-92aa-adc790d99f6f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:27.713161 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-22eca5be-4b46-48d8-ac8b-a1b8e6ba4f9b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:27.717550 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-12855f3f-3f3d-4afa-92aa-adc790d99f6f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:27.721386 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-22eca5be-4b46-48d8-ac8b-a1b8e6ba4f9b tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1507 microversion: 2.1 time: 0.242185 Jun 17 08:58:27.721962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 461/929] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:27 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1507 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:27.726226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-12855f3f-3f3d-4afa-92aa-adc790d99f6f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:27.727825 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-12855f3f-3f3d-4afa-92aa-adc790d99f6f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:27.728994 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-12855f3f-3f3d-4afa-92aa-adc790d99f6f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1729 microversion: 2.20 time: 0.238808 Jun 17 08:58:27.729535 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 469/930] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:27 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1729 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:58:27.815099 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-13fee7b9-4680-456b-9b07-085e7e615374 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:27.815729 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-13fee7b9-4680-456b-9b07-085e7e615374 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:27.821734 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-13fee7b9-4680-456b-9b07-085e7e615374 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:27.822181 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-13fee7b9-4680-456b-9b07-085e7e615374 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:27.822945 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-13fee7b9-4680-456b-9b07-085e7e615374 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:27.823411 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-13fee7b9-4680-456b-9b07-085e7e615374 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:27.961512 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-13fee7b9-4680-456b-9b07-085e7e615374 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:27.968842 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-13fee7b9-4680-456b-9b07-085e7e615374 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1263 microversion: 2.1 time: 0.158141 Jun 17 08:58:27.969404 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 462/931] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:27 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:28.737896 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-aa56fe56-173b-4a3d-9d9a-f7904ae0d615 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:28.738672 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-aa56fe56-173b-4a3d-9d9a-f7904ae0d615 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:28.745937 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-aa56fe56-173b-4a3d-9d9a-f7904ae0d615 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:28.746392 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-aa56fe56-173b-4a3d-9d9a-f7904ae0d615 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:28.747170 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-aa56fe56-173b-4a3d-9d9a-f7904ae0d615 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:28.747625 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1ddac71d-c5fd-498f-8a36-f6fc928969fc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:28.748059 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-aa56fe56-173b-4a3d-9d9a-f7904ae0d615 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:28.748691 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-1ddac71d-c5fd-498f-8a36-f6fc928969fc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:28.757483 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1ddac71d-c5fd-498f-8a36-f6fc928969fc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:28.757935 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1ddac71d-c5fd-498f-8a36-f6fc928969fc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:28.758713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1ddac71d-c5fd-498f-8a36-f6fc928969fc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:28.759151 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1ddac71d-c5fd-498f-8a36-f6fc928969fc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:28.960042 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-aa56fe56-173b-4a3d-9d9a-f7904ae0d615 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:28.968278 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-1ddac71d-c5fd-498f-8a36-f6fc928969fc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:28.974642 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-aa56fe56-173b-4a3d-9d9a-f7904ae0d615 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1507 microversion: 2.1 time: 0.240570 Jun 17 08:58:28.979419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 470/932] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:28 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1507 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:28.979682 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-1ddac71d-c5fd-498f-8a36-f6fc928969fc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:28.979947 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-1ddac71d-c5fd-498f-8a36-f6fc928969fc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:28.981141 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-1ddac71d-c5fd-498f-8a36-f6fc928969fc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1729 microversion: 2.20 time: 0.237917 Jun 17 08:58:28.992371 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 463/933] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:28 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1729 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:58:28.998512 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-965dee24-56bb-4dee-ab86-096393601446 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:28.998512 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-965dee24-56bb-4dee-ab86-096393601446 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:29.006570 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-965dee24-56bb-4dee-ab86-096393601446 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:29.007094 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-965dee24-56bb-4dee-ab86-096393601446 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:29.007921 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-965dee24-56bb-4dee-ab86-096393601446 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:29.008367 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-965dee24-56bb-4dee-ab86-096393601446 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:29.095691 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-f618f930-de55-4c55-997b-297ec87e1b48 req-43474162-9c5c-48ee-89bf-4e13a1fd65e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32006679-bcd4-46b4-b3b6-b2e0cc46ffc7", "name": "network-vif-deleted", "tag": "f04f9926-c78f-453a-92df-f4e826f339e0"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:58:29.105089 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-f618f930-de55-4c55-997b-297ec87e1b48 req-43474162-9c5c-48ee-89bf-4e13a1fd65e1 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:29.105612 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-f618f930-de55-4c55-997b-297ec87e1b48 req-43474162-9c5c-48ee-89bf-4e13a1fd65e1 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:29.117967 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-f618f930-de55-4c55-997b-297ec87e1b48 req-43474162-9c5c-48ee-89bf-4e13a1fd65e1 service nova] Creating event network-vif-deleted:f04f9926-c78f-453a-92df-f4e826f339e0 for instance 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 on hv-cinder-79760 Jun 17 08:58:29.122958 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-f618f930-de55-4c55-997b-297ec87e1b48 req-43474162-9c5c-48ee-89bf-4e13a1fd65e1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031633 Jun 17 08:58:29.126713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 464/934] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:58:29.210994 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-965dee24-56bb-4dee-ab86-096393601446 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:29.230382 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-965dee24-56bb-4dee-ab86-096393601446 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1263 microversion: 2.1 time: 0.236065 Jun 17 08:58:29.236316 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 471/935] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:28 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1263 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:58:29.991663 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=2 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:29.996564 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-17cf394a-35ed-4b84-a7f5-d585779223c1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:29.997462 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-17cf394a-35ed-4b84-a7f5-d585779223c1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:30.000588 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-c34ecf1d-1534-4a2d-8469-1191ed0be392 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:30.003500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-c34ecf1d-1534-4a2d-8469-1191ed0be392 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:30.006746 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-17cf394a-35ed-4b84-a7f5-d585779223c1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:30.007214 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-17cf394a-35ed-4b84-a7f5-d585779223c1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:30.008419 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-17cf394a-35ed-4b84-a7f5-d585779223c1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:30.008706 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-17cf394a-35ed-4b84-a7f5-d585779223c1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:30.011460 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=2 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:30.015802 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=6 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:30.015802 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c34ecf1d-1534-4a2d-8469-1191ed0be392 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:30.016184 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c34ecf1d-1534-4a2d-8469-1191ed0be392 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:30.017539 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c34ecf1d-1534-4a2d-8469-1191ed0be392 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:30.017996 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c34ecf1d-1534-4a2d-8469-1191ed0be392 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:30.088596 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-17cf394a-35ed-4b84-a7f5-d585779223c1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:30.097105 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-17cf394a-35ed-4b84-a7f5-d585779223c1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1293 microversion: 2.1 time: 0.106777 Jun 17 08:58:30.097689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 465/936] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:29 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1293 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:30.201806 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c34ecf1d-1534-4a2d-8469-1191ed0be392 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:30.211136 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c34ecf1d-1534-4a2d-8469-1191ed0be392 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:30.213120 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c34ecf1d-1534-4a2d-8469-1191ed0be392 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:30.214385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-c34ecf1d-1534-4a2d-8469-1191ed0be392 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1729 microversion: 2.20 time: 0.218382 Jun 17 08:58:30.217640 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 472/937] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:29 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1729 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:30.250177 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d9d9b5c9-e6e6-43c3-8fe6-28095123fb9d tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:30.251078 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-d9d9b5c9-e6e6-43c3-8fe6-28095123fb9d tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:30.257367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d9d9b5c9-e6e6-43c3-8fe6-28095123fb9d tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:30.257890 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d9d9b5c9-e6e6-43c3-8fe6-28095123fb9d tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:30.258730 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d9d9b5c9-e6e6-43c3-8fe6-28095123fb9d tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:30.259242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d9d9b5c9-e6e6-43c3-8fe6-28095123fb9d tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:30.405227 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d9d9b5c9-e6e6-43c3-8fe6-28095123fb9d tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:30.414449 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-d9d9b5c9-e6e6-43c3-8fe6-28095123fb9d tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1263 microversion: 2.1 time: 0.168132 Jun 17 08:58:30.415035 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 466/938] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:30 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1263 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:31.114691 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-78494a9b-ecdf-45fa-bd6c-3c9658ed71bb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:31.115590 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-78494a9b-ecdf-45fa-bd6c-3c9658ed71bb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:31.122180 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-78494a9b-ecdf-45fa-bd6c-3c9658ed71bb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:31.125632 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-78494a9b-ecdf-45fa-bd6c-3c9658ed71bb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:31.125632 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-78494a9b-ecdf-45fa-bd6c-3c9658ed71bb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:31.125632 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-78494a9b-ecdf-45fa-bd6c-3c9658ed71bb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:31.190786 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-78494a9b-ecdf-45fa-bd6c-3c9658ed71bb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:31.198487 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-78494a9b-ecdf-45fa-bd6c-3c9658ed71bb tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1293 microversion: 2.1 time: 0.088296 Jun 17 08:58:31.199066 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 473/939] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:31 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:31.233779 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-bdb807c4-484b-47a1-8182-246f50cfce77 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:31.234567 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-bdb807c4-484b-47a1-8182-246f50cfce77 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:31.241585 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bdb807c4-484b-47a1-8182-246f50cfce77 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:31.242038 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bdb807c4-484b-47a1-8182-246f50cfce77 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:31.242813 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bdb807c4-484b-47a1-8182-246f50cfce77 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:31.243250 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bdb807c4-484b-47a1-8182-246f50cfce77 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:31.387369 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-bdb807c4-484b-47a1-8182-246f50cfce77 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:31.396077 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-bdb807c4-484b-47a1-8182-246f50cfce77 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:31.403046 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-bdb807c4-484b-47a1-8182-246f50cfce77 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:31.403046 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-bdb807c4-484b-47a1-8182-246f50cfce77 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1729 microversion: 2.20 time: 0.169753 Jun 17 08:58:31.403046 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 467/940] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:31 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:31.431182 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-6e0c37e5-7e1c-4390-b1a9-48694103492a tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:31.432244 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-6e0c37e5-7e1c-4390-b1a9-48694103492a tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:31.438524 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6e0c37e5-7e1c-4390-b1a9-48694103492a tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:31.438977 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6e0c37e5-7e1c-4390-b1a9-48694103492a tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:31.439762 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6e0c37e5-7e1c-4390-b1a9-48694103492a tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:31.440202 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6e0c37e5-7e1c-4390-b1a9-48694103492a tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:31.587159 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-6e0c37e5-7e1c-4390-b1a9-48694103492a tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:31.602458 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-6e0c37e5-7e1c-4390-b1a9-48694103492a tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1263 microversion: 2.1 time: 0.174828 Jun 17 08:58:31.603964 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 474/941] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:31 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1263 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:32.215667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0913e331-1dca-4356-b7b6-91541cd522ed tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:32.216281 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0913e331-1dca-4356-b7b6-91541cd522ed tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:32.226018 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0913e331-1dca-4356-b7b6-91541cd522ed tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:32.227484 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0913e331-1dca-4356-b7b6-91541cd522ed tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:32.228498 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0913e331-1dca-4356-b7b6-91541cd522ed tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:32.229140 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0913e331-1dca-4356-b7b6-91541cd522ed tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:32.298226 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0913e331-1dca-4356-b7b6-91541cd522ed tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:32.307110 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0913e331-1dca-4356-b7b6-91541cd522ed tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1293 microversion: 2.1 time: 0.094940 Jun 17 08:58:32.307893 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 468/942] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:32 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:32.418021 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-60b349db-3e6b-4ea2-8fd4-656a92450883 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:32.418628 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-60b349db-3e6b-4ea2-8fd4-656a92450883 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:32.426265 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-60b349db-3e6b-4ea2-8fd4-656a92450883 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:32.430967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-60b349db-3e6b-4ea2-8fd4-656a92450883 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:32.430967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-60b349db-3e6b-4ea2-8fd4-656a92450883 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:32.430967 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-60b349db-3e6b-4ea2-8fd4-656a92450883 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:32.578216 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-60b349db-3e6b-4ea2-8fd4-656a92450883 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:32.587098 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-60b349db-3e6b-4ea2-8fd4-656a92450883 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:32.588692 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-60b349db-3e6b-4ea2-8fd4-656a92450883 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:32.590026 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-60b349db-3e6b-4ea2-8fd4-656a92450883 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1729 microversion: 2.20 time: 0.175976 Jun 17 08:58:32.599626 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 475/943] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:32 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:32.622039 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-4feb125d-f484-4004-a532-a30f79d12173 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:32.622681 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-4feb125d-f484-4004-a532-a30f79d12173 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:32.629661 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4feb125d-f484-4004-a532-a30f79d12173 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:32.630101 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4feb125d-f484-4004-a532-a30f79d12173 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:32.630876 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4feb125d-f484-4004-a532-a30f79d12173 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:32.631306 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4feb125d-f484-4004-a532-a30f79d12173 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:32.779999 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-4feb125d-f484-4004-a532-a30f79d12173 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:32.788314 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-4feb125d-f484-4004-a532-a30f79d12173 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1263 microversion: 2.1 time: 0.170846 Jun 17 08:58:32.789099 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 469/944] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:32 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1263 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:33.325230 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-3df0ba11-111a-42ea-8144-20016437f457 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:33.325870 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-3df0ba11-111a-42ea-8144-20016437f457 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:33.333757 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3df0ba11-111a-42ea-8144-20016437f457 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:33.334447 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3df0ba11-111a-42ea-8144-20016437f457 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:33.335288 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3df0ba11-111a-42ea-8144-20016437f457 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:33.335849 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3df0ba11-111a-42ea-8144-20016437f457 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:33.427884 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-3df0ba11-111a-42ea-8144-20016437f457 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:33.427884 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-3df0ba11-111a-42ea-8144-20016437f457 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1293 microversion: 2.1 time: 0.103749 Jun 17 08:58:33.427884 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 476/945] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:33 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1293 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:33.608496 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-f2e04d45-efe2-4afd-862d-336442a99130 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:33.609626 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-f2e04d45-efe2-4afd-862d-336442a99130 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:33.617296 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f2e04d45-efe2-4afd-862d-336442a99130 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:33.617794 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f2e04d45-efe2-4afd-862d-336442a99130 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:33.618583 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f2e04d45-efe2-4afd-862d-336442a99130 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:33.619014 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f2e04d45-efe2-4afd-862d-336442a99130 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:33.755311 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f2e04d45-efe2-4afd-862d-336442a99130 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:33.763991 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f2e04d45-efe2-4afd-862d-336442a99130 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:33.766021 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f2e04d45-efe2-4afd-862d-336442a99130 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:33.767447 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-f2e04d45-efe2-4afd-862d-336442a99130 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1729 microversion: 2.20 time: 0.163011 Jun 17 08:58:33.768034 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 470/946] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:33 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:33.805096 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-c82d0867-7415-4c35-b9bb-171d64329a18 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:33.805713 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-c82d0867-7415-4c35-b9bb-171d64329a18 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:33.812128 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c82d0867-7415-4c35-b9bb-171d64329a18 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:33.812627 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c82d0867-7415-4c35-b9bb-171d64329a18 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:33.814153 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c82d0867-7415-4c35-b9bb-171d64329a18 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:33.814596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c82d0867-7415-4c35-b9bb-171d64329a18 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:33.952958 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c82d0867-7415-4c35-b9bb-171d64329a18 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:33.961500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-c82d0867-7415-4c35-b9bb-171d64329a18 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1263 microversion: 2.1 time: 0.160132 Jun 17 08:58:33.962888 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 477/947] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:33 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:34.443332 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-297d66eb-ff8e-4189-9868-3f3f84ccf08f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:34.443978 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-297d66eb-ff8e-4189-9868-3f3f84ccf08f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:34.450484 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-297d66eb-ff8e-4189-9868-3f3f84ccf08f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:34.450790 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-297d66eb-ff8e-4189-9868-3f3f84ccf08f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:34.451684 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-297d66eb-ff8e-4189-9868-3f3f84ccf08f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:34.452080 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-297d66eb-ff8e-4189-9868-3f3f84ccf08f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:34.526849 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-297d66eb-ff8e-4189-9868-3f3f84ccf08f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:34.535159 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-297d66eb-ff8e-4189-9868-3f3f84ccf08f tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1293 microversion: 2.1 time: 0.095625 Jun 17 08:58:34.535971 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 471/948] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:34 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:34.787366 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-455954b0-70ec-4a33-aa63-c8035680d6d6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:34.811207 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-455954b0-70ec-4a33-aa63-c8035680d6d6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:34.811207 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-455954b0-70ec-4a33-aa63-c8035680d6d6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:34.811207 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-455954b0-70ec-4a33-aa63-c8035680d6d6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:34.811207 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-455954b0-70ec-4a33-aa63-c8035680d6d6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:34.811640 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-455954b0-70ec-4a33-aa63-c8035680d6d6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:34.939153 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-455954b0-70ec-4a33-aa63-c8035680d6d6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:34.947492 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-455954b0-70ec-4a33-aa63-c8035680d6d6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:34.948977 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-455954b0-70ec-4a33-aa63-c8035680d6d6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:34.950160 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-455954b0-70ec-4a33-aa63-c8035680d6d6 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1729 microversion: 2.20 time: 0.168293 Jun 17 08:58:34.955489 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 478/949] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:34 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:34.978078 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-bd497fda-2fab-4b37-bf05-cc167ed6671f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:34.978683 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-bd497fda-2fab-4b37-bf05-cc167ed6671f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:34.984987 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bd497fda-2fab-4b37-bf05-cc167ed6671f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:34.985796 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bd497fda-2fab-4b37-bf05-cc167ed6671f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:34.986754 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bd497fda-2fab-4b37-bf05-cc167ed6671f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:34.987186 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bd497fda-2fab-4b37-bf05-cc167ed6671f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:35.138708 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-bd497fda-2fab-4b37-bf05-cc167ed6671f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:35.147366 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-bd497fda-2fab-4b37-bf05-cc167ed6671f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1263 microversion: 2.1 time: 0.172946 Jun 17 08:58:35.148212 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 472/950] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:34 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1263 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:35.553039 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-8251d250-e003-4387-84d7-85d40f576de1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:35.553662 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-8251d250-e003-4387-84d7-85d40f576de1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:35.561109 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8251d250-e003-4387-84d7-85d40f576de1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:35.561577 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8251d250-e003-4387-84d7-85d40f576de1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:35.562432 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8251d250-e003-4387-84d7-85d40f576de1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:35.562877 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8251d250-e003-4387-84d7-85d40f576de1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:35.584809 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:35.630939 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-8251d250-e003-4387-84d7-85d40f576de1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:35.639042 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-8251d250-e003-4387-84d7-85d40f576de1 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1293 microversion: 2.1 time: 0.090420 Jun 17 08:58:35.639725 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 479/951] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:35 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:35.969638 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-947fe700-3d24-4371-a70e-a8308cc781be tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:35.970345 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-947fe700-3d24-4371-a70e-a8308cc781be tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:35.977365 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-947fe700-3d24-4371-a70e-a8308cc781be tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:35.977909 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-947fe700-3d24-4371-a70e-a8308cc781be tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:35.978755 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-947fe700-3d24-4371-a70e-a8308cc781be tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:35.979386 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-947fe700-3d24-4371-a70e-a8308cc781be tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:36.124469 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-947fe700-3d24-4371-a70e-a8308cc781be tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:36.127319 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:36.134056 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-947fe700-3d24-4371-a70e-a8308cc781be tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:36.135617 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-947fe700-3d24-4371-a70e-a8308cc781be tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:36.139114 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-947fe700-3d24-4371-a70e-a8308cc781be tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1729 microversion: 2.20 time: 0.171703 Jun 17 08:58:36.139114 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 473/952] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:35 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:36.165267 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-30281e87-4c22-4793-8e65-2b4d315168f6 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:36.165860 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-30281e87-4c22-4793-8e65-2b4d315168f6 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:36.173582 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-30281e87-4c22-4793-8e65-2b4d315168f6 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:36.174227 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-30281e87-4c22-4793-8e65-2b4d315168f6 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:36.174999 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-30281e87-4c22-4793-8e65-2b4d315168f6 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:36.175463 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-30281e87-4c22-4793-8e65-2b4d315168f6 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:36.322482 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-30281e87-4c22-4793-8e65-2b4d315168f6 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:36.331251 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-30281e87-4c22-4793-8e65-2b4d315168f6 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1263 microversion: 2.1 time: 0.169738 Jun 17 08:58:36.331909 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 480/953] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:36 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1263 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:36.658214 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1648021a-807c-435b-964f-963dc2b75f8c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:36.658770 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-1648021a-807c-435b-964f-963dc2b75f8c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:36.666313 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1648021a-807c-435b-964f-963dc2b75f8c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:36.666754 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1648021a-807c-435b-964f-963dc2b75f8c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:36.667556 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1648021a-807c-435b-964f-963dc2b75f8c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:36.667992 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1648021a-807c-435b-964f-963dc2b75f8c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:36.740008 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-1648021a-807c-435b-964f-963dc2b75f8c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:36.747617 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-1648021a-807c-435b-964f-963dc2b75f8c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1293 microversion: 2.1 time: 0.094068 Jun 17 08:58:36.757198 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 474/954] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:36 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:37.156104 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-6c980e86-4cbf-44ef-b2b0-63d75b4b415c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:37.156711 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-6c980e86-4cbf-44ef-b2b0-63d75b4b415c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:37.163916 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6c980e86-4cbf-44ef-b2b0-63d75b4b415c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:37.164420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6c980e86-4cbf-44ef-b2b0-63d75b4b415c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:37.165360 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6c980e86-4cbf-44ef-b2b0-63d75b4b415c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:37.166015 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6c980e86-4cbf-44ef-b2b0-63d75b4b415c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:37.302990 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-6c980e86-4cbf-44ef-b2b0-63d75b4b415c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:37.311902 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-6c980e86-4cbf-44ef-b2b0-63d75b4b415c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:37.313463 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-6c980e86-4cbf-44ef-b2b0-63d75b4b415c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:37.315259 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-6c980e86-4cbf-44ef-b2b0-63d75b4b415c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1729 microversion: 2.20 time: 0.162888 Jun 17 08:58:37.316508 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 481/955] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:37 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:37.351451 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-e3b31703-1598-497a-920b-e5fa5c2d74bd tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:37.351451 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-e3b31703-1598-497a-920b-e5fa5c2d74bd tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:37.358213 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e3b31703-1598-497a-920b-e5fa5c2d74bd tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:37.358773 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e3b31703-1598-497a-920b-e5fa5c2d74bd tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:37.359809 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e3b31703-1598-497a-920b-e5fa5c2d74bd tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:37.360945 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e3b31703-1598-497a-920b-e5fa5c2d74bd tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:37.516669 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-e3b31703-1598-497a-920b-e5fa5c2d74bd tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:37.524620 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-e3b31703-1598-497a-920b-e5fa5c2d74bd tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1263 microversion: 2.1 time: 0.180102 Jun 17 08:58:37.525202 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 475/956] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:37 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1263 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:37.764957 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e0104dee-f7b6-4be7-8bd4-8945cf1950da tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:37.765489 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-e0104dee-f7b6-4be7-8bd4-8945cf1950da tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:37.772702 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e0104dee-f7b6-4be7-8bd4-8945cf1950da tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:37.773196 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e0104dee-f7b6-4be7-8bd4-8945cf1950da tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:37.773987 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e0104dee-f7b6-4be7-8bd4-8945cf1950da tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:37.774445 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e0104dee-f7b6-4be7-8bd4-8945cf1950da tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:37.837305 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e0104dee-f7b6-4be7-8bd4-8945cf1950da tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:37.846915 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-e0104dee-f7b6-4be7-8bd4-8945cf1950da tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1293 microversion: 2.1 time: 0.085895 Jun 17 08:58:37.847525 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 482/957] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:37 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:38.334562 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-ee696cae-b0d7-410d-ae67-b28b194fac3f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:38.335071 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-ee696cae-b0d7-410d-ae67-b28b194fac3f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:38.341153 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ee696cae-b0d7-410d-ae67-b28b194fac3f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:38.341599 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ee696cae-b0d7-410d-ae67-b28b194fac3f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:38.342352 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ee696cae-b0d7-410d-ae67-b28b194fac3f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:38.342783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ee696cae-b0d7-410d-ae67-b28b194fac3f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:38.469788 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-ee696cae-b0d7-410d-ae67-b28b194fac3f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:38.477908 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-ee696cae-b0d7-410d-ae67-b28b194fac3f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:38.479439 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-ee696cae-b0d7-410d-ae67-b28b194fac3f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:38.480647 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-ee696cae-b0d7-410d-ae67-b28b194fac3f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1729 microversion: 2.20 time: 0.150390 Jun 17 08:58:38.481207 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 476/958] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:38 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:38.543210 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-4498a2cc-85c7-4f2a-aff5-9ed8e9d623e8 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:38.543881 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-4498a2cc-85c7-4f2a-aff5-9ed8e9d623e8 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:38.551390 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4498a2cc-85c7-4f2a-aff5-9ed8e9d623e8 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:38.551819 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4498a2cc-85c7-4f2a-aff5-9ed8e9d623e8 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:38.552614 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4498a2cc-85c7-4f2a-aff5-9ed8e9d623e8 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:38.553053 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4498a2cc-85c7-4f2a-aff5-9ed8e9d623e8 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:38.690904 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-4498a2cc-85c7-4f2a-aff5-9ed8e9d623e8 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:38.698786 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-4498a2cc-85c7-4f2a-aff5-9ed8e9d623e8 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1263 microversion: 2.1 time: 0.160502 Jun 17 08:58:38.699418 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 483/959] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:38 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:38.863903 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-45bf3692-fd5c-4989-931d-7e0e236a0b33 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:38.864511 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-45bf3692-fd5c-4989-931d-7e0e236a0b33 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:38.870529 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-45bf3692-fd5c-4989-931d-7e0e236a0b33 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:38.870920 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-45bf3692-fd5c-4989-931d-7e0e236a0b33 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:38.871710 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-45bf3692-fd5c-4989-931d-7e0e236a0b33 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:38.878618 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-45bf3692-fd5c-4989-931d-7e0e236a0b33 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:38.903897 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-45bf3692-fd5c-4989-931d-7e0e236a0b33 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:38.904348 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-45bf3692-fd5c-4989-931d-7e0e236a0b33 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:38.904795 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-45bf3692-fd5c-4989-931d-7e0e236a0b33 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lazy-loading 'fault' on Instance uuid 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:58:38.944802 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-45bf3692-fd5c-4989-931d-7e0e236a0b33 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:38.952388 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-45bf3692-fd5c-4989-931d-7e0e236a0b33 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1312 microversion: 2.1 time: 0.092446 Jun 17 08:58:38.952948 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 477/960] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:38 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:39.499337 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-b6343ed9-7202-47de-9d59-423e593d826a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:39.499971 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-b6343ed9-7202-47de-9d59-423e593d826a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:39.506960 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b6343ed9-7202-47de-9d59-423e593d826a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:39.512412 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b6343ed9-7202-47de-9d59-423e593d826a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:39.512412 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b6343ed9-7202-47de-9d59-423e593d826a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:39.512412 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b6343ed9-7202-47de-9d59-423e593d826a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:39.635181 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-b6343ed9-7202-47de-9d59-423e593d826a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:39.643767 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-b6343ed9-7202-47de-9d59-423e593d826a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:39.645265 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-b6343ed9-7202-47de-9d59-423e593d826a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:39.646430 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-b6343ed9-7202-47de-9d59-423e593d826a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1729 microversion: 2.20 time: 0.151247 Jun 17 08:58:39.646975 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 484/961] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:39 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:39.715510 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-403a61d0-ba19-4328-8b25-6cc45993fc78 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:39.716055 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-403a61d0-ba19-4328-8b25-6cc45993fc78 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:39.722974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-403a61d0-ba19-4328-8b25-6cc45993fc78 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:39.723461 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-403a61d0-ba19-4328-8b25-6cc45993fc78 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:39.724226 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-403a61d0-ba19-4328-8b25-6cc45993fc78 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:39.724662 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-403a61d0-ba19-4328-8b25-6cc45993fc78 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:39.858116 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-403a61d0-ba19-4328-8b25-6cc45993fc78 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:39.866029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-403a61d0-ba19-4328-8b25-6cc45993fc78 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1263 microversion: 2.1 time: 0.154505 Jun 17 08:58:39.866604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 478/962] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:39 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:39.970528 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-b90e3fcf-902d-495e-a72e-cc43a3117246 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:39.971058 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-b90e3fcf-902d-495e-a72e-cc43a3117246 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:39.977099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b90e3fcf-902d-495e-a72e-cc43a3117246 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:39.977558 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b90e3fcf-902d-495e-a72e-cc43a3117246 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:39.978324 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b90e3fcf-902d-495e-a72e-cc43a3117246 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:39.978766 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b90e3fcf-902d-495e-a72e-cc43a3117246 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:40.009488 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b90e3fcf-902d-495e-a72e-cc43a3117246 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:40.009953 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b90e3fcf-902d-495e-a72e-cc43a3117246 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:40.010409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.objects.instance [None req-b90e3fcf-902d-495e-a72e-cc43a3117246 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lazy-loading 'fault' on Instance uuid 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 {{(pid=129876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:58:40.052470 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-b90e3fcf-902d-495e-a72e-cc43a3117246 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:40.060756 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-b90e3fcf-902d-495e-a72e-cc43a3117246 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 200 len: 1312 microversion: 2.1 time: 0.094122 Jun 17 08:58:40.062076 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 485/963] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:39 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:40.664768 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0cf27497-2364-4cef-b6af-070e0f4e9b8b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:40.665389 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0cf27497-2364-4cef-b6af-070e0f4e9b8b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:40.671761 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0cf27497-2364-4cef-b6af-070e0f4e9b8b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:40.674192 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0cf27497-2364-4cef-b6af-070e0f4e9b8b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:40.674192 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0cf27497-2364-4cef-b6af-070e0f4e9b8b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:40.674192 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0cf27497-2364-4cef-b6af-070e0f4e9b8b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:40.814468 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0cf27497-2364-4cef-b6af-070e0f4e9b8b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:40.822771 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0cf27497-2364-4cef-b6af-070e0f4e9b8b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:40.824339 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0cf27497-2364-4cef-b6af-070e0f4e9b8b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:40.825497 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0cf27497-2364-4cef-b6af-070e0f4e9b8b tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1729 microversion: 2.20 time: 0.164843 Jun 17 08:58:40.826051 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 479/964] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:40 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:40.882722 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-470d9163-bc48-4faa-b2d5-5e806457c279 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:40.883334 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-470d9163-bc48-4faa-b2d5-5e806457c279 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:40.890013 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-470d9163-bc48-4faa-b2d5-5e806457c279 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:40.890467 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-470d9163-bc48-4faa-b2d5-5e806457c279 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:40.891871 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-470d9163-bc48-4faa-b2d5-5e806457c279 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:40.892339 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-470d9163-bc48-4faa-b2d5-5e806457c279 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:41.024740 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-470d9163-bc48-4faa-b2d5-5e806457c279 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:41.032380 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-470d9163-bc48-4faa-b2d5-5e806457c279 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1263 microversion: 2.1 time: 0.153520 Jun 17 08:58:41.033059 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 486/965] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:40 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:41.078206 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a59413a8-0b3d-4db3-bea5-b68bbf8d7e82 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:41.079548 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-a59413a8-0b3d-4db3-bea5-b68bbf8d7e82 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:41.085940 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a59413a8-0b3d-4db3-bea5-b68bbf8d7e82 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:41.086479 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a59413a8-0b3d-4db3-bea5-b68bbf8d7e82 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:41.087316 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a59413a8-0b3d-4db3-bea5-b68bbf8d7e82 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:41.087783 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a59413a8-0b3d-4db3-bea5-b68bbf8d7e82 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:41.101911 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-a59413a8-0b3d-4db3-bea5-b68bbf8d7e82 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] HTTP exception thrown: Instance 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 could not be found. Jun 17 08:58:41.103604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a59413a8-0b3d-4db3-bea5-b68bbf8d7e82 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Request method failure captured: Jun 17 08:58:41.103604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 HTTP/1.1 Jun 17 08:58:41.103604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 08:58:41.103604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 08:58:41.103604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 08:58:41.103604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 08:58:41.103604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 08:58:41.103604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 08:58:41.103604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 08:58:41.103604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 08:58:41.103604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirED5Euje8Qg466HZfzI6zCL6KuGF5BH7fLi2Pmi8ij3gYtPI6C-73btuLA8X2nSXoPf1noq4TUDtlOwCduBS9xL7_px9uXygULPkVYrbJQFD3qLcxvxV0BbEkrPf4s4e0iVeOxxYopv4Knn2YUw0jM9QPTqum78gRvcAfDjXtIdH9hY Jun 17 08:58:41.103604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 08:58:41.103604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 08:58:41.103604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 08:58:41.103604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 08:58:41.103604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 08:58:41.103604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 08:58:41.103604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: 6cd5b6aa6edd4bafa8aec3e9d28ae980 Jun 17 08:58:41.103604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1528519624 Jun 17 08:58:41.103604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 08:58:41.103604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 08:58:41.105345 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6cd5b6aa6edd4bafa8aec3e9d28ae980"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6cd5b6aa6edd4bafa8aec3e9d28ae980"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6cd5b6aa6edd4bafa8aec3e9d28ae980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6cd5b6aa6edd4bafa8aec3e9d28ae980"}]}] Jun 17 08:58:41.105345 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1528519624 Jun 17 08:58:41.105345 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: 6cd5b6aa6edd4bafa8aec3e9d28ae980 Jun 17 08:58:41.105345 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1528519624 Jun 17 08:58:41.105345 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-ServerRescueNegativeTestJSON-1528519624-project Jun 17 08:58:41.105345 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 08:58:41.105345 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 08:58:41.105345 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: 5e4214dbd10d491eb6afa50321edca88 Jun 17 08:58:41.105345 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1528519624-project Jun 17 08:58:41.105345 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: > Jun 17 08:58:41.105345 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Instance 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 could not be found. Jun 17 08:58:41.105345 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'id': '32006679-bcd4-46b4-b3b6-b2e0cc46ffc7'} Jun 17 08:58:41.106272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:58:41.106272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:58:41.106272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:58:41.106272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:58:41.106272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:58:41.106272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:58:41.106272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:58:41.106272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:58:41.106272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:58:41.106272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:58:41.106272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 could not be found. Jun 17 08:58:41.106272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:58:41.106272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:58:41.106272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:58:41.106272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:58:41.106272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:58:41.106272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:58:41.106272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:58:41.106272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:58:41.106272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:58:41.108405 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:58:41.108405 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:58:41.108405 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:58:41.108405 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:58:41.108405 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:58:41.108405 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:58:41.108405 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:58:41.108405 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 could not be found. Jun 17 08:58:41.108405 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:58:41.108405 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:58:41.108405 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:58:41.108405 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:58:41.108405 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:58:41.108405 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:58:41.108405 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:58:41.108405 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:58:41.108405 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 could not be found. Jun 17 08:58:41.108405 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:58:41.109915 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a59413a8-0b3d-4db3-bea5-b68bbf8d7e82 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Returning 404 to user: Instance 32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:58:41.109915 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-a59413a8-0b3d-4db3-bea5-b68bbf8d7e82 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7" status: 404 len: 111 microversion: 2.1 time: 0.030853 Jun 17 08:58:41.109915 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 480/966] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:41 2022] GET /compute/v2.1/servers/32006679-bcd4-46b4-b3b6-b2e0cc46ffc7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:58:41.115464 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-2674627a-bf6e-4a88-aaa1-b1e6269bb246 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:41.115986 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-2674627a-bf6e-4a88-aaa1-b1e6269bb246 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:41.122084 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2674627a-bf6e-4a88-aaa1-b1e6269bb246 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:41.122540 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2674627a-bf6e-4a88-aaa1-b1e6269bb246 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:41.123326 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2674627a-bf6e-4a88-aaa1-b1e6269bb246 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:41.123804 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2674627a-bf6e-4a88-aaa1-b1e6269bb246 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:41.150942 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-2674627a-bf6e-4a88-aaa1-b1e6269bb246 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Going to try to terminate instance {{(pid=129876) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:58:41.453090 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-2674627a-bf6e-4a88-aaa1-b1e6269bb246 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "DELETE /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 204 len: 0 microversion: 2.1 time: 0.342006 Jun 17 08:58:41.453685 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 487/967] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 08:58:41 2022] DELETE /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:58:41.462024 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-e5fae7fe-5d91-46c9-bec1-b73ab37673aa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:41.462629 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-e5fae7fe-5d91-46c9-bec1-b73ab37673aa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:41.468649 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e5fae7fe-5d91-46c9-bec1-b73ab37673aa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:41.469091 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e5fae7fe-5d91-46c9-bec1-b73ab37673aa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:41.469960 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e5fae7fe-5d91-46c9-bec1-b73ab37673aa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:41.470389 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e5fae7fe-5d91-46c9-bec1-b73ab37673aa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:41.605974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-e5fae7fe-5d91-46c9-bec1-b73ab37673aa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:41.614524 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-e5fae7fe-5d91-46c9-bec1-b73ab37673aa tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.156287 Jun 17 08:58:41.615121 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 481/968] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:41 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:41.844870 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-31aee065-f0ba-4a6f-9a8c-ece3c737d070 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:41.845571 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-31aee065-f0ba-4a6f-9a8c-ece3c737d070 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:41.851640 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-31aee065-f0ba-4a6f-9a8c-ece3c737d070 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:41.852093 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-31aee065-f0ba-4a6f-9a8c-ece3c737d070 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:41.852852 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-31aee065-f0ba-4a6f-9a8c-ece3c737d070 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:41.853294 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-31aee065-f0ba-4a6f-9a8c-ece3c737d070 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:41.986868 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-31aee065-f0ba-4a6f-9a8c-ece3c737d070 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:41.994876 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-31aee065-f0ba-4a6f-9a8c-ece3c737d070 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:41.996406 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-31aee065-f0ba-4a6f-9a8c-ece3c737d070 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:41.997597 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-31aee065-f0ba-4a6f-9a8c-ece3c737d070 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1729 microversion: 2.20 time: 0.157054 Jun 17 08:58:41.998149 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 488/969] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:41 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:42.049165 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-b74a07fb-4a04-42ba-94df-f1e0c948fd82 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:42.049843 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-b74a07fb-4a04-42ba-94df-f1e0c948fd82 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:42.056780 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b74a07fb-4a04-42ba-94df-f1e0c948fd82 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:42.057200 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b74a07fb-4a04-42ba-94df-f1e0c948fd82 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:42.057970 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b74a07fb-4a04-42ba-94df-f1e0c948fd82 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:42.058409 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b74a07fb-4a04-42ba-94df-f1e0c948fd82 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:42.187489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-b74a07fb-4a04-42ba-94df-f1e0c948fd82 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:42.195513 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-b74a07fb-4a04-42ba-94df-f1e0c948fd82 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1263 microversion: 2.1 time: 0.150832 Jun 17 08:58:42.196080 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 482/970] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:42 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:42.632381 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-d1d4747b-8a89-489f-bcdf-d0b544bb3220 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:42.633006 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-d1d4747b-8a89-489f-bcdf-d0b544bb3220 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:42.640271 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d1d4747b-8a89-489f-bcdf-d0b544bb3220 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:42.640728 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d1d4747b-8a89-489f-bcdf-d0b544bb3220 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:42.641513 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d1d4747b-8a89-489f-bcdf-d0b544bb3220 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:42.641957 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d1d4747b-8a89-489f-bcdf-d0b544bb3220 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:42.794956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-d1d4747b-8a89-489f-bcdf-d0b544bb3220 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:42.803678 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-d1d4747b-8a89-489f-bcdf-d0b544bb3220 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.175127 Jun 17 08:58:42.804275 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 489/971] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:42 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:43.017932 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-83f5d98b-0fdd-4bf7-a201-c1718a5f3952 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:43.018548 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-83f5d98b-0fdd-4bf7-a201-c1718a5f3952 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:43.024986 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-83f5d98b-0fdd-4bf7-a201-c1718a5f3952 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:43.025432 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-83f5d98b-0fdd-4bf7-a201-c1718a5f3952 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:43.026198 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-83f5d98b-0fdd-4bf7-a201-c1718a5f3952 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:43.026635 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-83f5d98b-0fdd-4bf7-a201-c1718a5f3952 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:43.160451 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-83f5d98b-0fdd-4bf7-a201-c1718a5f3952 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:43.168503 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-83f5d98b-0fdd-4bf7-a201-c1718a5f3952 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:43.169985 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-83f5d98b-0fdd-4bf7-a201-c1718a5f3952 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:43.171139 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-83f5d98b-0fdd-4bf7-a201-c1718a5f3952 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1729 microversion: 2.20 time: 0.157899 Jun 17 08:58:43.171724 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 483/972] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:43 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:43.217983 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-7a267c00-9881-49e5-9cfa-3cf8156cc3b4 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:43.218767 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-7a267c00-9881-49e5-9cfa-3cf8156cc3b4 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:43.225571 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7a267c00-9881-49e5-9cfa-3cf8156cc3b4 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:43.226022 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7a267c00-9881-49e5-9cfa-3cf8156cc3b4 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:43.226794 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7a267c00-9881-49e5-9cfa-3cf8156cc3b4 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:43.227238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7a267c00-9881-49e5-9cfa-3cf8156cc3b4 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:43.361873 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-7a267c00-9881-49e5-9cfa-3cf8156cc3b4 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:43.372930 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-7a267c00-9881-49e5-9cfa-3cf8156cc3b4 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1263 microversion: 2.1 time: 0.164418 Jun 17 08:58:43.373551 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 490/973] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:43 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1263 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:43.499936 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-f83f1a03-910b-450b-afdf-1f83ecc930ab req-050103a7-2776-4a44-81da-607a78d39481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba9b8cb-042a-41e7-a0bf-2f511d8a685a", "name": "network-vif-plugged", "status": "completed", "tag": "1e938f08-b678-482d-a29c-cf7d85d201ba"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:58:43.508682 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-f83f1a03-910b-450b-afdf-1f83ecc930ab req-050103a7-2776-4a44-81da-607a78d39481 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:43.509233 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-f83f1a03-910b-450b-afdf-1f83ecc930ab req-050103a7-2776-4a44-81da-607a78d39481 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:43.523174 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-f83f1a03-910b-450b-afdf-1f83ecc930ab req-050103a7-2776-4a44-81da-607a78d39481 service nova] Creating event network-vif-plugged:1e938f08-b678-482d-a29c-cf7d85d201ba for instance 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a on hv-cinder-79760 Jun 17 08:58:43.528402 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-f83f1a03-910b-450b-afdf-1f83ecc930ab req-050103a7-2776-4a44-81da-607a78d39481 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032246 Jun 17 08:58:43.529041 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 484/974] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:58:43.822119 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-50f7b535-9036-4f65-ad99-46a21002a017 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:43.822731 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-50f7b535-9036-4f65-ad99-46a21002a017 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:43.829578 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-50f7b535-9036-4f65-ad99-46a21002a017 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:43.830041 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-50f7b535-9036-4f65-ad99-46a21002a017 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:43.830811 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-50f7b535-9036-4f65-ad99-46a21002a017 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:43.831248 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-50f7b535-9036-4f65-ad99-46a21002a017 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:43.980788 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-50f7b535-9036-4f65-ad99-46a21002a017 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:43.988558 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-50f7b535-9036-4f65-ad99-46a21002a017 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1521 microversion: 2.1 time: 0.170393 Jun 17 08:58:43.989332 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 491/975] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:43 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:44.190910 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-e68a0d6d-4859-4302-aa75-99da5e1703b3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:44.192294 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-e68a0d6d-4859-4302-aa75-99da5e1703b3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:44.200012 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e68a0d6d-4859-4302-aa75-99da5e1703b3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:44.200602 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e68a0d6d-4859-4302-aa75-99da5e1703b3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:44.202150 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e68a0d6d-4859-4302-aa75-99da5e1703b3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:44.202655 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e68a0d6d-4859-4302-aa75-99da5e1703b3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:44.343678 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-e68a0d6d-4859-4302-aa75-99da5e1703b3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:44.351885 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-e68a0d6d-4859-4302-aa75-99da5e1703b3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:44.353487 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-e68a0d6d-4859-4302-aa75-99da5e1703b3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:44.354655 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-e68a0d6d-4859-4302-aa75-99da5e1703b3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1729 microversion: 2.20 time: 0.169336 Jun 17 08:58:44.355224 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 485/976] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:44 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:44.390073 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-34a646d8-3383-4e73-9828-c69736892cd2 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:44.391504 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-34a646d8-3383-4e73-9828-c69736892cd2 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:44.398196 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-34a646d8-3383-4e73-9828-c69736892cd2 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:44.402174 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-34a646d8-3383-4e73-9828-c69736892cd2 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:44.402174 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-34a646d8-3383-4e73-9828-c69736892cd2 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:44.402174 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-34a646d8-3383-4e73-9828-c69736892cd2 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:44.488321 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-c2567bff-1cd2-46a0-9e34-a1356c954000 req-4393e611-c03f-4724-a09b-7b07ec0bf66d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "597a895e-45db-42bf-9c7f-40a13eedc48b", "name": "network-vif-deleted", "tag": "bcdeb004-186e-437b-8253-335f017eebbd"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:58:44.496539 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-c2567bff-1cd2-46a0-9e34-a1356c954000 req-4393e611-c03f-4724-a09b-7b07ec0bf66d service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:44.496983 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-c2567bff-1cd2-46a0-9e34-a1356c954000 req-4393e611-c03f-4724-a09b-7b07ec0bf66d service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:44.509255 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-c2567bff-1cd2-46a0-9e34-a1356c954000 req-4393e611-c03f-4724-a09b-7b07ec0bf66d service nova] Creating event network-vif-deleted:bcdeb004-186e-437b-8253-335f017eebbd for instance 597a895e-45db-42bf-9c7f-40a13eedc48b on hv-cinder-79760 Jun 17 08:58:44.514240 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-c2567bff-1cd2-46a0-9e34-a1356c954000 req-4393e611-c03f-4724-a09b-7b07ec0bf66d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030689 Jun 17 08:58:44.515177 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 486/977] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:58:44.542344 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-34a646d8-3383-4e73-9828-c69736892cd2 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:44.550230 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-34a646d8-3383-4e73-9828-c69736892cd2 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1263 microversion: 2.1 time: 0.164100 Jun 17 08:58:44.550804 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 492/978] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:44 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:45.006503 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-edede3a8-d1f8-4196-ba97-926b710f4f3c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:45.007107 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-edede3a8-d1f8-4196-ba97-926b710f4f3c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:45.013417 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-edede3a8-d1f8-4196-ba97-926b710f4f3c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:45.013872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-edede3a8-d1f8-4196-ba97-926b710f4f3c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:45.014642 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-edede3a8-d1f8-4196-ba97-926b710f4f3c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:45.015087 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-edede3a8-d1f8-4196-ba97-926b710f4f3c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:45.081775 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-edede3a8-d1f8-4196-ba97-926b710f4f3c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:45.089373 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-edede3a8-d1f8-4196-ba97-926b710f4f3c tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1307 microversion: 2.1 time: 0.087556 Jun 17 08:58:45.090057 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 487/979] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:45 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1307 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:45.372712 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-043d1f10-7ea6-4840-96cf-6aa6bb91c739 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:45.373374 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-043d1f10-7ea6-4840-96cf-6aa6bb91c739 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:45.380383 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-043d1f10-7ea6-4840-96cf-6aa6bb91c739 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:45.380849 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-043d1f10-7ea6-4840-96cf-6aa6bb91c739 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:45.381701 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-043d1f10-7ea6-4840-96cf-6aa6bb91c739 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:45.382078 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-043d1f10-7ea6-4840-96cf-6aa6bb91c739 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:45.520131 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-043d1f10-7ea6-4840-96cf-6aa6bb91c739 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:45.528038 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-043d1f10-7ea6-4840-96cf-6aa6bb91c739 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:45.530292 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-043d1f10-7ea6-4840-96cf-6aa6bb91c739 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:45.530678 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-043d1f10-7ea6-4840-96cf-6aa6bb91c739 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1729 microversion: 2.20 time: 0.162198 Jun 17 08:58:45.531384 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 493/980] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:45 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:45.543696 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-62d5082c-dd5c-408d-ab03-76f612d0d2ed req-d5bcc731-f351-48c6-a292-31520a8cb4cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b18a4b5-273d-4ec1-81a8-ca670de385ea", "name": "network-vif-plugged", "status": "completed", "tag": "02d2e50f-49e7-4067-86ed-da24c07d5aea"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:58:45.552350 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-62d5082c-dd5c-408d-ab03-76f612d0d2ed req-d5bcc731-f351-48c6-a292-31520a8cb4cd service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:45.552787 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-62d5082c-dd5c-408d-ab03-76f612d0d2ed req-d5bcc731-f351-48c6-a292-31520a8cb4cd service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:45.564522 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-62d5082c-dd5c-408d-ab03-76f612d0d2ed req-d5bcc731-f351-48c6-a292-31520a8cb4cd service nova] Creating event network-vif-plugged:02d2e50f-49e7-4067-86ed-da24c07d5aea for instance 2b18a4b5-273d-4ec1-81a8-ca670de385ea on hv-cinder-79760 Jun 17 08:58:45.567666 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-dcb25027-cdd4-4118-a7e2-9b6d93aad060 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:45.568293 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-dcb25027-cdd4-4118-a7e2-9b6d93aad060 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:45.569399 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-62d5082c-dd5c-408d-ab03-76f612d0d2ed req-d5bcc731-f351-48c6-a292-31520a8cb4cd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029329 Jun 17 08:58:45.569994 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 488/981] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:58:45.574670 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dcb25027-cdd4-4118-a7e2-9b6d93aad060 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:45.575126 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dcb25027-cdd4-4118-a7e2-9b6d93aad060 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:45.575927 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dcb25027-cdd4-4118-a7e2-9b6d93aad060 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:45.576368 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dcb25027-cdd4-4118-a7e2-9b6d93aad060 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:45.581379 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:45.711729 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-dcb25027-cdd4-4118-a7e2-9b6d93aad060 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:45.719469 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-dcb25027-cdd4-4118-a7e2-9b6d93aad060 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1448 microversion: 2.1 time: 0.156143 Jun 17 08:58:45.720127 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 494/982] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:45 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1448 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:58:45.737230 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-7133bb3e-a73f-45b2-ad2e-b1c2a878f5b6 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:45.737937 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-7133bb3e-a73f-45b2-ad2e-b1c2a878f5b6 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:45.744250 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7133bb3e-a73f-45b2-ad2e-b1c2a878f5b6 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:45.744702 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7133bb3e-a73f-45b2-ad2e-b1c2a878f5b6 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:45.745480 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7133bb3e-a73f-45b2-ad2e-b1c2a878f5b6 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:45.745917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7133bb3e-a73f-45b2-ad2e-b1c2a878f5b6 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:45.881089 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-7133bb3e-a73f-45b2-ad2e-b1c2a878f5b6 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:45.889301 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-7133bb3e-a73f-45b2-ad2e-b1c2a878f5b6 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1448 microversion: 2.1 time: 0.157478 Jun 17 08:58:45.889925 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 489/983] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:45 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1448 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:46.107113 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a53dd49a-e9cd-4412-921c-84b59f00e235 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:46.107762 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a53dd49a-e9cd-4412-921c-84b59f00e235 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:46.114482 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a53dd49a-e9cd-4412-921c-84b59f00e235 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:46.114941 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a53dd49a-e9cd-4412-921c-84b59f00e235 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:46.115744 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a53dd49a-e9cd-4412-921c-84b59f00e235 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:46.116189 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a53dd49a-e9cd-4412-921c-84b59f00e235 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:46.149031 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a53dd49a-e9cd-4412-921c-84b59f00e235 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:46.149477 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a53dd49a-e9cd-4412-921c-84b59f00e235 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:46.149947 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.objects.instance [None req-a53dd49a-e9cd-4412-921c-84b59f00e235 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lazy-loading 'fault' on Instance uuid 597a895e-45db-42bf-9c7f-40a13eedc48b {{(pid=129876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:58:46.199825 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a53dd49a-e9cd-4412-921c-84b59f00e235 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4214dbd10d491eb6afa50321edca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:46.208801 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a53dd49a-e9cd-4412-921c-84b59f00e235 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 200 len: 1312 microversion: 2.1 time: 0.105435 Jun 17 08:58:46.209624 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 495/984] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:46 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:46.549710 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-fb740cd0-0de6-4d6d-baa5-621162575b3a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:46.550349 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-fb740cd0-0de6-4d6d-baa5-621162575b3a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:46.557493 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fb740cd0-0de6-4d6d-baa5-621162575b3a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:46.557952 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fb740cd0-0de6-4d6d-baa5-621162575b3a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:46.558732 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fb740cd0-0de6-4d6d-baa5-621162575b3a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:46.559174 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fb740cd0-0de6-4d6d-baa5-621162575b3a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:46.694571 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-fb740cd0-0de6-4d6d-baa5-621162575b3a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:46.703115 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-fb740cd0-0de6-4d6d-baa5-621162575b3a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:46.705262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-fb740cd0-0de6-4d6d-baa5-621162575b3a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:46.706488 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-fb740cd0-0de6-4d6d-baa5-621162575b3a tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1729 microversion: 2.20 time: 0.161764 Jun 17 08:58:46.707054 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 490/985] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:46 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:58:46.770263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-59c68822-511e-40e8-832a-13cc77a7155d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:46.771008 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-59c68822-511e-40e8-832a-13cc77a7155d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:46.777735 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-59c68822-511e-40e8-832a-13cc77a7155d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:46.781251 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-59c68822-511e-40e8-832a-13cc77a7155d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:46.781251 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-59c68822-511e-40e8-832a-13cc77a7155d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:46.781251 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-59c68822-511e-40e8-832a-13cc77a7155d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:46.803859 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-59c68822-511e-40e8-832a-13cc77a7155d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170/ips" status: 200 len: 149 microversion: 2.1 time: 0.037664 Jun 17 08:58:46.804688 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 496/986] 10.222.0.78 () {58 vars in 1247 bytes} [Fri Jun 17 08:58:46 2022] GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:58:47.227157 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-ec995953-02c2-43d5-b7d8-35a1421ea023 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:47.227959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-ec995953-02c2-43d5-b7d8-35a1421ea023 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] [instance: 597a895e-45db-42bf-9c7f-40a13eedc48b] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:47.234120 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ec995953-02c2-43d5-b7d8-35a1421ea023 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:47.234573 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ec995953-02c2-43d5-b7d8-35a1421ea023 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:47.235372 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ec995953-02c2-43d5-b7d8-35a1421ea023 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:47.235814 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ec995953-02c2-43d5-b7d8-35a1421ea023 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:47.249977 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-ec995953-02c2-43d5-b7d8-35a1421ea023 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] HTTP exception thrown: Instance 597a895e-45db-42bf-9c7f-40a13eedc48b could not be found. Jun 17 08:58:47.251713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-ec995953-02c2-43d5-b7d8-35a1421ea023 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Request method failure captured: Jun 17 08:58:47.251713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b HTTP/1.1 Jun 17 08:58:47.251713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 08:58:47.251713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 08:58:47.251713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 08:58:47.251713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 08:58:47.251713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 08:58:47.251713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 08:58:47.251713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 08:58:47.251713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 08:58:47.251713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirED5Euje8Qg466HZfzI6zCL6KuGF5BH7fLi2Pmi8ij3gYtPI6C-73btuLA8X2nSXoPf1noq4TUDtlOwCduBS9xL7_px9uXygULPkVYrbJQFD3qLcxvxV0BbEkrPf4s4e0iVeOxxYopv4Knn2YUw0jM9QPTqum78gRvcAfDjXtIdH9hY Jun 17 08:58:47.251713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 08:58:47.251713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 08:58:47.251713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 08:58:47.251713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 08:58:47.251713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 08:58:47.251713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 08:58:47.251713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: 6cd5b6aa6edd4bafa8aec3e9d28ae980 Jun 17 08:58:47.251713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1528519624 Jun 17 08:58:47.251713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 08:58:47.251713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 08:58:47.253306 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6cd5b6aa6edd4bafa8aec3e9d28ae980"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6cd5b6aa6edd4bafa8aec3e9d28ae980"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6cd5b6aa6edd4bafa8aec3e9d28ae980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6cd5b6aa6edd4bafa8aec3e9d28ae980"}]}] Jun 17 08:58:47.253306 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1528519624 Jun 17 08:58:47.253306 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: 6cd5b6aa6edd4bafa8aec3e9d28ae980 Jun 17 08:58:47.253306 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1528519624 Jun 17 08:58:47.253306 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-ServerRescueNegativeTestJSON-1528519624-project Jun 17 08:58:47.253306 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 08:58:47.253306 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 08:58:47.253306 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: 5e4214dbd10d491eb6afa50321edca88 Jun 17 08:58:47.253306 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1528519624-project Jun 17 08:58:47.253306 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: > Jun 17 08:58:47.253306 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Instance 597a895e-45db-42bf-9c7f-40a13eedc48b could not be found. Jun 17 08:58:47.253306 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'id': '597a895e-45db-42bf-9c7f-40a13eedc48b'} Jun 17 08:58:47.254258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:58:47.254258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:58:47.254258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:58:47.254258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:58:47.254258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:58:47.254258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:58:47.254258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:58:47.254258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:58:47.254258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:58:47.254258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:58:47.254258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 597a895e-45db-42bf-9c7f-40a13eedc48b could not be found. Jun 17 08:58:47.254258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:58:47.254258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:58:47.254258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:58:47.254258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:58:47.254258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:58:47.254258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:58:47.254258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:58:47.254258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:58:47.254258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:58:47.255754 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:58:47.255754 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:58:47.255754 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:58:47.255754 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:58:47.255754 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:58:47.255754 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:58:47.255754 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:58:47.255754 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 597a895e-45db-42bf-9c7f-40a13eedc48b could not be found. Jun 17 08:58:47.255754 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:58:47.255754 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:58:47.255754 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:58:47.255754 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:58:47.255754 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:58:47.255754 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:58:47.255754 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:58:47.255754 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:58:47.255754 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 597a895e-45db-42bf-9c7f-40a13eedc48b could not be found. Jun 17 08:58:47.255754 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:58:47.257288 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-ec995953-02c2-43d5-b7d8-35a1421ea023 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] Returning 404 to user: Instance 597a895e-45db-42bf-9c7f-40a13eedc48b could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:58:47.257288 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-ec995953-02c2-43d5-b7d8-35a1421ea023 tempest-ServerRescueNegativeTestJSON-1528519624 tempest-ServerRescueNegativeTestJSON-1528519624-project] 10.222.0.78 "GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b" status: 404 len: 111 microversion: 2.1 time: 0.030130 Jun 17 08:58:47.257740 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 491/987] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:47 2022] GET /compute/v2.1/servers/597a895e-45db-42bf-9c7f-40a13eedc48b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:58:47.725763 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-063253be-4f0f-48cd-a278-c5340f396af1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:47.726487 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-063253be-4f0f-48cd-a278-c5340f396af1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:47.733782 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-063253be-4f0f-48cd-a278-c5340f396af1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:47.734419 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-063253be-4f0f-48cd-a278-c5340f396af1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:47.735397 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-063253be-4f0f-48cd-a278-c5340f396af1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:47.735850 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-063253be-4f0f-48cd-a278-c5340f396af1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:47.872561 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-063253be-4f0f-48cd-a278-c5340f396af1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:47.882378 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-063253be-4f0f-48cd-a278-c5340f396af1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:47.884556 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-063253be-4f0f-48cd-a278-c5340f396af1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:47.885757 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-063253be-4f0f-48cd-a278-c5340f396af1 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1729 microversion: 2.20 time: 0.164296 Jun 17 08:58:47.890317 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 497/988] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:47 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:48.446442 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-13a9c9a2-c9c6-4d69-923b-2b4de4f9c70b tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a81e24c1-c6b3-4c63-9c17-382e6f4fed01"}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:58:48.447601 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-13a9c9a2-c9c6-4d69-923b-2b4de4f9c70b tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:48.454460 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-13a9c9a2-c9c6-4d69-923b-2b4de4f9c70b tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:48.455074 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-13a9c9a2-c9c6-4d69-923b-2b4de4f9c70b tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:48.455872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-13a9c9a2-c9c6-4d69-923b-2b4de4f9c70b tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:48.456576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-13a9c9a2-c9c6-4d69-923b-2b4de4f9c70b tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:48.697366 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:48.776535 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-5863ff53-8527-487b-9a4c-3ee49442e016 req-203f22d7-9408-4b0c-aabb-3061a7b9665e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ba9b8cb-042a-41e7-a0bf-2f511d8a685a", "tag": "1e938f08-b678-482d-a29c-cf7d85d201ba"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:58:48.805894 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-5863ff53-8527-487b-9a4c-3ee49442e016 req-203f22d7-9408-4b0c-aabb-3061a7b9665e service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:48.806732 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-5863ff53-8527-487b-9a4c-3ee49442e016 req-203f22d7-9408-4b0c-aabb-3061a7b9665e service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:48.836805 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-5863ff53-8527-487b-9a4c-3ee49442e016 req-203f22d7-9408-4b0c-aabb-3061a7b9665e service nova] Creating event network-changed:1e938f08-b678-482d-a29c-cf7d85d201ba for instance 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a on hv-cinder-79760 Jun 17 08:58:48.843179 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-5863ff53-8527-487b-9a4c-3ee49442e016 req-203f22d7-9408-4b0c-aabb-3061a7b9665e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071419 Jun 17 08:58:48.844654 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 498/989] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:58:48.908246 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-c077064f-8376-479c-8d7a-43cafbec3e1f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:48.910720 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-c077064f-8376-479c-8d7a-43cafbec3e1f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:48.920964 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c077064f-8376-479c-8d7a-43cafbec3e1f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:48.922066 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c077064f-8376-479c-8d7a-43cafbec3e1f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:48.925765 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c077064f-8376-479c-8d7a-43cafbec3e1f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:48.926485 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c077064f-8376-479c-8d7a-43cafbec3e1f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:49.093135 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c077064f-8376-479c-8d7a-43cafbec3e1f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:49.126308 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c077064f-8376-479c-8d7a-43cafbec3e1f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:49.130817 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c077064f-8376-479c-8d7a-43cafbec3e1f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:49.133385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-c077064f-8376-479c-8d7a-43cafbec3e1f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1729 microversion: 2.20 time: 0.231595 Jun 17 08:58:49.135155 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 499/990] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:48 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:49.470269 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-13a9c9a2-c9c6-4d69-923b-2b4de4f9c70b tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "POST /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.027133 Jun 17 08:58:49.493254 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 492/991] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jun 17 08:58:48 2022] POST /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170/os-volume_attachments => generated 194 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:58:50.163757 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-fecfed69-772f-444b-a0b7-849d107b2fd9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:50.164786 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-fecfed69-772f-444b-a0b7-849d107b2fd9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:50.179217 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fecfed69-772f-444b-a0b7-849d107b2fd9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:50.179911 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fecfed69-772f-444b-a0b7-849d107b2fd9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:50.181028 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fecfed69-772f-444b-a0b7-849d107b2fd9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:50.182112 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fecfed69-772f-444b-a0b7-849d107b2fd9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:50.337560 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-fecfed69-772f-444b-a0b7-849d107b2fd9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:50.346708 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-fecfed69-772f-444b-a0b7-849d107b2fd9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:50.348371 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-fecfed69-772f-444b-a0b7-849d107b2fd9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:50.349570 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-fecfed69-772f-444b-a0b7-849d107b2fd9 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1716 microversion: 2.20 time: 0.199439 Jun 17 08:58:50.357513 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 500/992] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:58:50 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1716 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:58:57.188712 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-b3f0960c-3273-4a85-bc9d-e73a3d92f108 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:57.191695 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-b3f0960c-3273-4a85-bc9d-e73a3d92f108 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:57.191695 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:57.196668 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b3f0960c-3273-4a85-bc9d-e73a3d92f108 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:57.197093 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b3f0960c-3273-4a85-bc9d-e73a3d92f108 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:57.198172 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b3f0960c-3273-4a85-bc9d-e73a3d92f108 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:57.198498 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b3f0960c-3273-4a85-bc9d-e73a3d92f108 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:57.283167 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-b3f0960c-3273-4a85-bc9d-e73a3d92f108 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lazy-loading 'services' on Instance uuid 2167779f-efa1-428a-9841-1863be4d7170 {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:58:57.493205 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-b3f0960c-3273-4a85-bc9d-e73a3d92f108 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170/os-volume_attachments/a81e24c1-c6b3-4c63-9c17-382e6f4fed01" status: 202 len: 0 microversion: 2.1 time: 0.310133 Jun 17 08:58:57.493789 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 493/993] 10.222.0.78 () {58 vars in 1415 bytes} [Fri Jun 17 08:58:57 2022] DELETE /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170/os-volume_attachments/a81e24c1-c6b3-4c63-9c17-382e6f4fed01 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:58:57.504374 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-4221eb56-96c2-4c44-91ce-f13d95b7fa81 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:57.505895 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-4221eb56-96c2-4c44-91ce-f13d95b7fa81 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:57.509255 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:57.514540 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4221eb56-96c2-4c44-91ce-f13d95b7fa81 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:57.515004 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4221eb56-96c2-4c44-91ce-f13d95b7fa81 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:57.516152 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4221eb56-96c2-4c44-91ce-f13d95b7fa81 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:57.516769 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4221eb56-96c2-4c44-91ce-f13d95b7fa81 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:57.557360 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-4221eb56-96c2-4c44-91ce-f13d95b7fa81 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057359 Jun 17 08:58:57.558336 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 501/994] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 08:58:57 2022] GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:58:58.572259 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-87826d41-213c-4890-accd-c95f6712219d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:58.573322 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-87826d41-213c-4890-accd-c95f6712219d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:58.581408 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-87826d41-213c-4890-accd-c95f6712219d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:58.581921 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-87826d41-213c-4890-accd-c95f6712219d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:58.582629 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-87826d41-213c-4890-accd-c95f6712219d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:58.583061 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-87826d41-213c-4890-accd-c95f6712219d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:58.619272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-87826d41-213c-4890-accd-c95f6712219d tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047890 Jun 17 08:58:58.624028 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 494/995] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 08:58:58 2022] GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:58:59.632331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-dcd10713-3ed7-4f1c-b470-0e7549d2784c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:59.633262 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-dcd10713-3ed7-4f1c-b470-0e7549d2784c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:59.640068 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dcd10713-3ed7-4f1c-b470-0e7549d2784c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:59.641832 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dcd10713-3ed7-4f1c-b470-0e7549d2784c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:59.641832 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dcd10713-3ed7-4f1c-b470-0e7549d2784c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:59.641832 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dcd10713-3ed7-4f1c-b470-0e7549d2784c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:59.671118 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-dcd10713-3ed7-4f1c-b470-0e7549d2784c tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043006 Jun 17 08:58:59.671636 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 502/996] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 08:58:59 2022] GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 08:58:59.731097 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-969df854-51ac-4441-a299-fadc9c79facf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:59.731656 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-969df854-51ac-4441-a299-fadc9c79facf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:59.738985 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-969df854-51ac-4441-a299-fadc9c79facf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:59.739505 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-969df854-51ac-4441-a299-fadc9c79facf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:59.740292 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-969df854-51ac-4441-a299-fadc9c79facf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:59.740738 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-969df854-51ac-4441-a299-fadc9c79facf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:59.766700 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-969df854-51ac-4441-a299-fadc9c79facf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Going to try to terminate instance {{(pid=129875) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:59:00.076325 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-969df854-51ac-4441-a299-fadc9c79facf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170" status: 204 len: 0 microversion: 2.1 time: 0.348660 Jun 17 08:59:00.082314 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 495/997] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 08:58:59 2022] DELETE /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:59:00.086165 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-948b04bb-eb02-4555-9dfb-8dc7b6c95222 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:00.086790 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-948b04bb-eb02-4555-9dfb-8dc7b6c95222 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:00.093143 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-948b04bb-eb02-4555-9dfb-8dc7b6c95222 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:00.093595 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-948b04bb-eb02-4555-9dfb-8dc7b6c95222 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:00.095192 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-948b04bb-eb02-4555-9dfb-8dc7b6c95222 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:00.095666 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-948b04bb-eb02-4555-9dfb-8dc7b6c95222 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:00.230425 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-948b04bb-eb02-4555-9dfb-8dc7b6c95222 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:00.238877 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-948b04bb-eb02-4555-9dfb-8dc7b6c95222 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170" status: 200 len: 1677 microversion: 2.1 time: 0.156558 Jun 17 08:59:00.239845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 503/998] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:00 2022] GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:59:01.257868 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0d9f8bab-b87c-4fb5-9310-cc750014bacf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:01.258566 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0d9f8bab-b87c-4fb5-9310-cc750014bacf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:01.265045 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0d9f8bab-b87c-4fb5-9310-cc750014bacf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:01.265505 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0d9f8bab-b87c-4fb5-9310-cc750014bacf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:01.266916 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0d9f8bab-b87c-4fb5-9310-cc750014bacf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:01.267448 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0d9f8bab-b87c-4fb5-9310-cc750014bacf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:01.402061 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0d9f8bab-b87c-4fb5-9310-cc750014bacf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:01.409984 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0d9f8bab-b87c-4fb5-9310-cc750014bacf tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170" status: 200 len: 1677 microversion: 2.1 time: 0.156471 Jun 17 08:59:01.410635 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 496/999] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:01 2022] GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:59:02.427925 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a1cfa2a1-c092-445b-a8af-8fe20a9ed810 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:02.429276 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a1cfa2a1-c092-445b-a8af-8fe20a9ed810 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:02.436231 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a1cfa2a1-c092-445b-a8af-8fe20a9ed810 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:02.436683 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a1cfa2a1-c092-445b-a8af-8fe20a9ed810 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:02.438116 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a1cfa2a1-c092-445b-a8af-8fe20a9ed810 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:02.438774 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a1cfa2a1-c092-445b-a8af-8fe20a9ed810 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:02.607058 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a1cfa2a1-c092-445b-a8af-8fe20a9ed810 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:02.617984 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a1cfa2a1-c092-445b-a8af-8fe20a9ed810 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170" status: 200 len: 1677 microversion: 2.1 time: 0.194104 Jun 17 08:59:02.618642 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 504/1000] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:02 2022] GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170 => generated 1677 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:59:03.024417 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-815a076a-cce7-44cf-a726-a48646fb7d2a req-237716bb-9bfc-4739-9cf9-364b0cef5f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2167779f-efa1-428a-9841-1863be4d7170", "name": "network-vif-deleted", "tag": "44844b56-2912-46ac-a3c4-665b072ff6da"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:59:03.032550 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-815a076a-cce7-44cf-a726-a48646fb7d2a req-237716bb-9bfc-4739-9cf9-364b0cef5f3b service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:03.033650 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-815a076a-cce7-44cf-a726-a48646fb7d2a req-237716bb-9bfc-4739-9cf9-364b0cef5f3b service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:03.044983 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-815a076a-cce7-44cf-a726-a48646fb7d2a req-237716bb-9bfc-4739-9cf9-364b0cef5f3b service nova] Creating event network-vif-deleted:44844b56-2912-46ac-a3c4-665b072ff6da for instance 2167779f-efa1-428a-9841-1863be4d7170 on hv-cinder-79760 Jun 17 08:59:03.050765 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-815a076a-cce7-44cf-a726-a48646fb7d2a req-237716bb-9bfc-4739-9cf9-364b0cef5f3b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033286 Jun 17 08:59:03.051693 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 497/1001] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:59:03.635960 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-fc9bae9e-2bdf-4429-9998-147f1644d4c8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:03.637664 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-fc9bae9e-2bdf-4429-9998-147f1644d4c8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:03.646169 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fc9bae9e-2bdf-4429-9998-147f1644d4c8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:03.647222 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fc9bae9e-2bdf-4429-9998-147f1644d4c8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:03.647848 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fc9bae9e-2bdf-4429-9998-147f1644d4c8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:03.648415 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fc9bae9e-2bdf-4429-9998-147f1644d4c8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:03.685656 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fc9bae9e-2bdf-4429-9998-147f1644d4c8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:03.686262 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fc9bae9e-2bdf-4429-9998-147f1644d4c8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:03.686729 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.objects.instance [None req-fc9bae9e-2bdf-4429-9998-147f1644d4c8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lazy-loading 'fault' on Instance uuid 2167779f-efa1-428a-9841-1863be4d7170 {{(pid=129876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:59:03.731158 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-fc9bae9e-2bdf-4429-9998-147f1644d4c8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bb3df8b4b649388d1a0f6c24e18f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794e7ebcf5c3436081b8e8d39907b655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:03.742255 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-fc9bae9e-2bdf-4429-9998-147f1644d4c8 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170" status: 200 len: 1328 microversion: 2.1 time: 0.110225 Jun 17 08:59:03.743206 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 505/1002] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:03 2022] GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170 => generated 1328 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:59:04.761612 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-6110ea7d-de26-4d77-9e92-f17465092b63 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:04.762307 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-6110ea7d-de26-4d77-9e92-f17465092b63 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:04.769214 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6110ea7d-de26-4d77-9e92-f17465092b63 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:04.769665 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6110ea7d-de26-4d77-9e92-f17465092b63 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:04.770460 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6110ea7d-de26-4d77-9e92-f17465092b63 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:04.770900 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6110ea7d-de26-4d77-9e92-f17465092b63 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:04.785592 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-6110ea7d-de26-4d77-9e92-f17465092b63 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] HTTP exception thrown: Instance 2167779f-efa1-428a-9841-1863be4d7170 could not be found. Jun 17 08:59:04.787265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-6110ea7d-de26-4d77-9e92-f17465092b63 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Request method failure captured: Jun 17 08:59:04.787265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170 HTTP/1.1 Jun 17 08:59:04.787265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 08:59:04.787265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 08:59:04.787265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 08:59:04.787265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 08:59:04.787265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 08:59:04.787265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 08:59:04.787265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 08:59:04.787265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 08:59:04.787265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirECoefK_2BxjZgVOeODeD0JulOcw4b3dCrWlpFY_cQoAEUxcK30AdtBELaLH-kVfcQ6VKJx7aLTz7Z0L639CzJLSrkIUHMaE3fnQwSThKfCgM9dozYdAIITDcNAYtXkDc4HYT-B7uJX_QV7RNcl_PdXigEFPXJ9IRk3STBItMRTcdRI Jun 17 08:59:04.787265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 08:59:04.787265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 08:59:04.787265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 08:59:04.787265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 08:59:04.787265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 08:59:04.787265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 08:59:04.787265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:59:04.787265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:04.787265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 08:59:04.787265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 08:59:04.788982 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}] Jun 17 08:59:04.788982 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:04.788982 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:59:04.788982 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:04.788982 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:59:04.788982 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 08:59:04.788982 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 08:59:04.788982 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: 01bb3df8b4b649388d1a0f6c24e18f1b Jun 17 08:59:04.788982 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:59:04.788982 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: > Jun 17 08:59:04.788982 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Instance 2167779f-efa1-428a-9841-1863be4d7170 could not be found. Jun 17 08:59:04.788982 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'id': '2167779f-efa1-428a-9841-1863be4d7170'} Jun 17 08:59:04.789897 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:59:04.789897 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:04.789897 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:59:04.789897 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:59:04.789897 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:59:04.789897 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:59:04.789897 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:59:04.789897 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:59:04.789897 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:59:04.789897 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:59:04.789897 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2167779f-efa1-428a-9841-1863be4d7170 could not be found. Jun 17 08:59:04.789897 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:04.789897 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:04.789897 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:04.789897 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:04.789897 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:04.789897 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:04.789897 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:59:04.789897 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:59:04.789897 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:59:04.791458 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:59:04.791458 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:59:04.791458 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:59:04.791458 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:59:04.791458 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:59:04.791458 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:59:04.791458 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:59:04.791458 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2167779f-efa1-428a-9841-1863be4d7170 could not be found. Jun 17 08:59:04.791458 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:04.791458 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:04.791458 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:04.791458 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:04.791458 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:04.791458 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:04.791458 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:59:04.791458 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:59:04.791458 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2167779f-efa1-428a-9841-1863be4d7170 could not be found. Jun 17 08:59:04.791458 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:04.793106 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-6110ea7d-de26-4d77-9e92-f17465092b63 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Returning 404 to user: Instance 2167779f-efa1-428a-9841-1863be4d7170 could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:59:04.793106 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-6110ea7d-de26-4d77-9e92-f17465092b63 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170" status: 404 len: 111 microversion: 2.1 time: 0.031904 Jun 17 08:59:04.793106 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 498/1003] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:04 2022] GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:59:04.798983 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-7db2d986-33f6-4cb4-bb9a-5045781dbd09 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '.version_select at 0x7fbc4434eca0>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:04.848557 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-7db2d986-33f6-4cb4-bb9a-5045781dbd09 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-9423753" status: 202 len: 0 microversion: 2.1 time: 0.054335 Jun 17 08:59:04.849083 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 506/1004] 10.222.0.78 () {58 vars in 1211 bytes} [Fri Jun 17 08:59:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-9423753 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:59:06.959786 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-6f7f5779-6b45-4039-8daf-207280fcefb1 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:06.960377 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-6f7f5779-6b45-4039-8daf-207280fcefb1 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:06.969504 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6f7f5779-6b45-4039-8daf-207280fcefb1 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:06.970517 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6f7f5779-6b45-4039-8daf-207280fcefb1 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:06.971963 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6f7f5779-6b45-4039-8daf-207280fcefb1 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:06.972409 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6f7f5779-6b45-4039-8daf-207280fcefb1 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:06.989408 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-6f7f5779-6b45-4039-8daf-207280fcefb1 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] HTTP exception thrown: Instance 2167779f-efa1-428a-9841-1863be4d7170 could not be found. Jun 17 08:59:06.991272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-6f7f5779-6b45-4039-8daf-207280fcefb1 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Request method failure captured: Jun 17 08:59:06.991272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: DELETE /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170 HTTP/1.1 Jun 17 08:59:06.991272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 08:59:06.991272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 08:59:06.991272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 08:59:06.991272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 08:59:06.991272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 08:59:06.991272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 08:59:06.991272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 08:59:06.991272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 08:59:06.991272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirECoefK_2BxjZgVOeODeD0JulOcw4b3dCrWlpFY_cQoAEUxcK30AdtBELaLH-kVfcQ6VKJx7aLTz7Z0L639CzJLSrkIUHMaE3fnQwSThKfCgM9dozYdAIITDcNAYtXkDc4HYT-B7uJX_QV7RNcl_PdXigEFPXJ9IRk3STBItMRTcdRI Jun 17 08:59:06.991272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 08:59:06.991272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 08:59:06.991272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 08:59:06.991272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 08:59:06.991272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 08:59:06.991272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 08:59:06.991272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:59:06.991272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:06.991272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 08:59:06.991272 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 08:59:06.993184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}] Jun 17 08:59:06.993184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:06.993184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:59:06.993184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:06.993184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:59:06.993184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 08:59:06.993184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 08:59:06.993184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: 01bb3df8b4b649388d1a0f6c24e18f1b Jun 17 08:59:06.993184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:59:06.993184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: > Jun 17 08:59:06.993184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Instance 2167779f-efa1-428a-9841-1863be4d7170 could not be found. Jun 17 08:59:06.993184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'id': '2167779f-efa1-428a-9841-1863be4d7170'} Jun 17 08:59:06.994182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:59:06.994182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:06.994182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:59:06.994182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:59:06.994182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:59:06.994182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:59:06.994182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:59:06.994182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:59:06.994182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:59:06.994182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:59:06.994182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2167779f-efa1-428a-9841-1863be4d7170 could not be found. Jun 17 08:59:06.994182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:06.994182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:06.994182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:06.994182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:06.994182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:06.994182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:06.994182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:59:06.994182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:59:06.994182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:59:06.995689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:59:06.995689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 08:59:06.995689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 08:59:06.995689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 08:59:06.995689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 08:59:06.995689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:59:06.995689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:59:06.995689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:59:06.995689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:59:06.995689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2167779f-efa1-428a-9841-1863be4d7170 could not be found. Jun 17 08:59:06.995689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:06.995689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:06.995689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:06.995689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:06.995689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:06.995689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:06.995689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:59:06.995689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:59:06.995689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2167779f-efa1-428a-9841-1863be4d7170 could not be found. Jun 17 08:59:06.995689 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:06.997505 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-6f7f5779-6b45-4039-8daf-207280fcefb1 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Returning 404 to user: Instance 2167779f-efa1-428a-9841-1863be4d7170 could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:59:06.998110 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-6f7f5779-6b45-4039-8daf-207280fcefb1 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170" status: 404 len: 111 microversion: 2.1 time: 0.042187 Jun 17 08:59:07.002724 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 499/1005] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 08:59:06 2022] DELETE /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:59:07.009205 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a651bb1e-71fc-422b-a30b-ea5b1f26c475 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:07.010357 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a651bb1e-71fc-422b-a30b-ea5b1f26c475 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 2167779f-efa1-428a-9841-1863be4d7170] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:07.019849 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a651bb1e-71fc-422b-a30b-ea5b1f26c475 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:07.020606 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a651bb1e-71fc-422b-a30b-ea5b1f26c475 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:07.021690 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a651bb1e-71fc-422b-a30b-ea5b1f26c475 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:07.022291 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a651bb1e-71fc-422b-a30b-ea5b1f26c475 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:07.038047 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-a651bb1e-71fc-422b-a30b-ea5b1f26c475 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] HTTP exception thrown: Instance 2167779f-efa1-428a-9841-1863be4d7170 could not be found. Jun 17 08:59:07.040268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a651bb1e-71fc-422b-a30b-ea5b1f26c475 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Request method failure captured: Jun 17 08:59:07.040268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170 HTTP/1.1 Jun 17 08:59:07.040268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:59:07.040268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:59:07.040268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:59:07.040268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 08:59:07.040268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:59:07.040268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:59:07.040268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:59:07.040268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:59:07.040268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirECoefK_2BxjZgVOeODeD0JulOcw4b3dCrWlpFY_cQoAEUxcK30AdtBELaLH-kVfcQ6VKJx7aLTz7Z0L639CzJLSrkIUHMaE3fnQwSThKfCgM9dozYdAIITDcNAYtXkDc4HYT-B7uJX_QV7RNcl_PdXigEFPXJ9IRk3STBItMRTcdRI Jun 17 08:59:07.040268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:59:07.040268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:59:07.040268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:59:07.040268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:59:07.040268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:59:07.040268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:59:07.040268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:59:07.040268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:07.040268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:59:07.040268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:59:07.041821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}] Jun 17 08:59:07.041821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:07.041821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:59:07.041821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:07.041821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:59:07.041821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:59:07.041821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:59:07.041821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: 01bb3df8b4b649388d1a0f6c24e18f1b Jun 17 08:59:07.041821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:59:07.041821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 08:59:07.041821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Instance 2167779f-efa1-428a-9841-1863be4d7170 could not be found. Jun 17 08:59:07.041821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'id': '2167779f-efa1-428a-9841-1863be4d7170'} Jun 17 08:59:07.042641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:59:07.042641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:07.042641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:59:07.042641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:59:07.042641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:59:07.042641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:59:07.042641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:59:07.042641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:59:07.042641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:59:07.042641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:59:07.042641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2167779f-efa1-428a-9841-1863be4d7170 could not be found. Jun 17 08:59:07.042641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:07.042641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:07.042641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:07.042641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:07.042641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:07.042641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:07.042641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:59:07.042641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:59:07.042641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:59:07.050323 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:59:07.050323 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:59:07.050323 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:59:07.050323 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:59:07.050323 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:59:07.050323 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:59:07.050323 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:59:07.050323 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2167779f-efa1-428a-9841-1863be4d7170 could not be found. Jun 17 08:59:07.050323 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:07.050323 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:07.050323 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:07.050323 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:07.050323 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:07.050323 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:07.050323 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:59:07.050323 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:59:07.050323 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2167779f-efa1-428a-9841-1863be4d7170 could not be found. Jun 17 08:59:07.050323 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:07.052329 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a651bb1e-71fc-422b-a30b-ea5b1f26c475 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Returning 404 to user: Instance 2167779f-efa1-428a-9841-1863be4d7170 could not be found. {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:59:07.052329 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a651bb1e-71fc-422b-a30b-ea5b1f26c475 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170" status: 404 len: 111 microversion: 2.1 time: 0.037596 Jun 17 08:59:07.052329 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 507/1006] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:07 2022] GET /compute/v2.1/servers/2167779f-efa1-428a-9841-1863be4d7170 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:59:08.355059 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a6606ba7-3c8d-4742-8ae7-018696cb0133 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:08.356213 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-a6606ba7-3c8d-4742-8ae7-018696cb0133 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:08.363671 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a6606ba7-3c8d-4742-8ae7-018696cb0133 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:08.364170 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a6606ba7-3c8d-4742-8ae7-018696cb0133 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:08.365126 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a6606ba7-3c8d-4742-8ae7-018696cb0133 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:08.365567 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a6606ba7-3c8d-4742-8ae7-018696cb0133 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:08.380041 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-a6606ba7-3c8d-4742-8ae7-018696cb0133 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] HTTP exception thrown: Instance fab8f2eb-71c8-4956-b693-06f73bf86964 could not be found. Jun 17 08:59:08.381690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a6606ba7-3c8d-4742-8ae7-018696cb0133 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Request method failure captured: Jun 17 08:59:08.381690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: DELETE /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 HTTP/1.1 Jun 17 08:59:08.381690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 08:59:08.381690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 08:59:08.381690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 08:59:08.381690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 08:59:08.381690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 08:59:08.381690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 08:59:08.381690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 08:59:08.381690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 08:59:08.381690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirECoefK_2BxjZgVOeODeD0JulOcw4b3dCrWlpFY_cQoAEUxcK30AdtBELaLH-kVfcQ6VKJx7aLTz7Z0L639CzJLSrkIUHMaE3fnQwSThKfCgM9dozYdAIITDcNAYtXkDc4HYT-B7uJX_QV7RNcl_PdXigEFPXJ9IRk3STBItMRTcdRI Jun 17 08:59:08.381690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 08:59:08.381690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 08:59:08.381690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 08:59:08.381690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 08:59:08.381690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 08:59:08.381690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 08:59:08.381690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:59:08.381690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:08.381690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 08:59:08.381690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 08:59:08.383258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}] Jun 17 08:59:08.383258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:08.383258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:59:08.383258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:08.383258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:59:08.383258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 08:59:08.383258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 08:59:08.383258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: 01bb3df8b4b649388d1a0f6c24e18f1b Jun 17 08:59:08.383258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:59:08.383258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: > Jun 17 08:59:08.383258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Instance fab8f2eb-71c8-4956-b693-06f73bf86964 could not be found. Jun 17 08:59:08.383258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'id': 'fab8f2eb-71c8-4956-b693-06f73bf86964'} Jun 17 08:59:08.384185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:59:08.384185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:08.384185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:59:08.384185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:59:08.384185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:59:08.384185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:59:08.384185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:59:08.384185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:59:08.384185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:59:08.384185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:59:08.384185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fab8f2eb-71c8-4956-b693-06f73bf86964 could not be found. Jun 17 08:59:08.384185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:08.384185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:08.384185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:08.384185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:08.384185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:08.384185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:08.384185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:59:08.384185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:59:08.384185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:59:08.386215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:59:08.386215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 08:59:08.386215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 08:59:08.386215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 08:59:08.386215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 08:59:08.386215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:59:08.386215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:59:08.386215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:59:08.386215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:59:08.386215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fab8f2eb-71c8-4956-b693-06f73bf86964 could not be found. Jun 17 08:59:08.386215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:08.386215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:08.386215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:08.386215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:08.386215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:08.386215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:08.386215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:59:08.386215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:59:08.386215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fab8f2eb-71c8-4956-b693-06f73bf86964 could not be found. Jun 17 08:59:08.386215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:08.387835 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a6606ba7-3c8d-4742-8ae7-018696cb0133 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Returning 404 to user: Instance fab8f2eb-71c8-4956-b693-06f73bf86964 could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:59:08.387835 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-a6606ba7-3c8d-4742-8ae7-018696cb0133 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964" status: 404 len: 111 microversion: 2.1 time: 0.032579 Jun 17 08:59:08.387835 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 500/1007] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 08:59:08 2022] DELETE /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:59:08.393513 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-f4793166-bc3b-40f0-abe7-c68f01588103 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:08.394165 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-f4793166-bc3b-40f0-abe7-c68f01588103 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: fab8f2eb-71c8-4956-b693-06f73bf86964] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:08.400862 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f4793166-bc3b-40f0-abe7-c68f01588103 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:08.401322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f4793166-bc3b-40f0-abe7-c68f01588103 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:08.402130 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f4793166-bc3b-40f0-abe7-c68f01588103 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:08.415776 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-f4793166-bc3b-40f0-abe7-c68f01588103 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:08.417693 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-f4793166-bc3b-40f0-abe7-c68f01588103 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] HTTP exception thrown: Instance fab8f2eb-71c8-4956-b693-06f73bf86964 could not be found. Jun 17 08:59:08.419241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-f4793166-bc3b-40f0-abe7-c68f01588103 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Request method failure captured: Jun 17 08:59:08.419241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 HTTP/1.1 Jun 17 08:59:08.419241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:59:08.419241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:59:08.419241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:59:08.419241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 08:59:08.419241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:59:08.419241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:59:08.419241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:59:08.419241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:59:08.419241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirECoefK_2BxjZgVOeODeD0JulOcw4b3dCrWlpFY_cQoAEUxcK30AdtBELaLH-kVfcQ6VKJx7aLTz7Z0L639CzJLSrkIUHMaE3fnQwSThKfCgM9dozYdAIITDcNAYtXkDc4HYT-B7uJX_QV7RNcl_PdXigEFPXJ9IRk3STBItMRTcdRI Jun 17 08:59:08.419241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:59:08.419241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:59:08.419241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:59:08.419241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:59:08.419241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:59:08.419241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:59:08.419241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:59:08.419241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:08.419241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:59:08.419241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:59:08.420845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}] Jun 17 08:59:08.420845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:08.420845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:59:08.420845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:08.420845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:59:08.420845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:59:08.420845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:59:08.420845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: 01bb3df8b4b649388d1a0f6c24e18f1b Jun 17 08:59:08.420845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:59:08.420845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 08:59:08.420845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Instance fab8f2eb-71c8-4956-b693-06f73bf86964 could not be found. Jun 17 08:59:08.420845 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'id': 'fab8f2eb-71c8-4956-b693-06f73bf86964'} Jun 17 08:59:08.421749 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:59:08.421749 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:08.421749 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:59:08.421749 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:59:08.421749 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:59:08.421749 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:59:08.421749 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:59:08.421749 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:59:08.421749 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:59:08.421749 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:59:08.421749 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fab8f2eb-71c8-4956-b693-06f73bf86964 could not be found. Jun 17 08:59:08.421749 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:08.421749 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:08.421749 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:08.421749 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:08.421749 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:08.421749 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:08.421749 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:59:08.421749 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:59:08.421749 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:59:08.423322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:59:08.423322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:59:08.423322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:59:08.423322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:59:08.423322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:59:08.423322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:59:08.423322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:59:08.423322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fab8f2eb-71c8-4956-b693-06f73bf86964 could not be found. Jun 17 08:59:08.423322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:08.423322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:08.423322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:08.423322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:08.423322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:08.423322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:08.423322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:59:08.423322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:59:08.423322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fab8f2eb-71c8-4956-b693-06f73bf86964 could not be found. Jun 17 08:59:08.423322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:08.424638 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-f4793166-bc3b-40f0-abe7-c68f01588103 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Returning 404 to user: Instance fab8f2eb-71c8-4956-b693-06f73bf86964 could not be found. {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:59:08.424638 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-f4793166-bc3b-40f0-abe7-c68f01588103 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964" status: 404 len: 111 microversion: 2.1 time: 0.031781 Jun 17 08:59:08.424638 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 508/1008] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:08 2022] GET /compute/v2.1/servers/fab8f2eb-71c8-4956-b693-06f73bf86964 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:59:08.429640 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-119298b8-4508-465f-8cfc-878cab77ea49 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:08.430135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-119298b8-4508-465f-8cfc-878cab77ea49 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:08.436928 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-119298b8-4508-465f-8cfc-878cab77ea49 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:08.437428 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-119298b8-4508-465f-8cfc-878cab77ea49 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:08.438502 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-119298b8-4508-465f-8cfc-878cab77ea49 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:08.438990 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-119298b8-4508-465f-8cfc-878cab77ea49 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:08.454512 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-119298b8-4508-465f-8cfc-878cab77ea49 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] HTTP exception thrown: Instance 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d could not be found. Jun 17 08:59:08.456135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-119298b8-4508-465f-8cfc-878cab77ea49 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Request method failure captured: Jun 17 08:59:08.456135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: DELETE /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d HTTP/1.1 Jun 17 08:59:08.456135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 08:59:08.456135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 08:59:08.456135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 08:59:08.456135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 08:59:08.456135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 08:59:08.456135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 08:59:08.456135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 08:59:08.456135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 08:59:08.456135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirECoefK_2BxjZgVOeODeD0JulOcw4b3dCrWlpFY_cQoAEUxcK30AdtBELaLH-kVfcQ6VKJx7aLTz7Z0L639CzJLSrkIUHMaE3fnQwSThKfCgM9dozYdAIITDcNAYtXkDc4HYT-B7uJX_QV7RNcl_PdXigEFPXJ9IRk3STBItMRTcdRI Jun 17 08:59:08.456135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 08:59:08.456135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 08:59:08.456135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 08:59:08.456135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 08:59:08.456135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 08:59:08.456135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 08:59:08.456135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:59:08.456135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:08.456135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 08:59:08.456135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 08:59:08.457485 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}] Jun 17 08:59:08.457485 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:08.457485 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:59:08.457485 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:08.457485 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:59:08.457485 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 08:59:08.457485 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 08:59:08.457485 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: 01bb3df8b4b649388d1a0f6c24e18f1b Jun 17 08:59:08.457485 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:59:08.457485 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: > Jun 17 08:59:08.457485 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Instance 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d could not be found. Jun 17 08:59:08.457485 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'id': '4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d'} Jun 17 08:59:08.458220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:59:08.458220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:08.458220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:59:08.458220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:59:08.458220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:59:08.458220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:59:08.458220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:59:08.458220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:59:08.458220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:59:08.458220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:59:08.458220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d could not be found. Jun 17 08:59:08.458220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:08.458220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:08.458220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:08.458220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:08.458220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:08.458220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:08.458220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:59:08.458220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:59:08.458220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:59:08.459799 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:59:08.459799 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 08:59:08.459799 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 08:59:08.459799 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 08:59:08.459799 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 08:59:08.459799 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:59:08.459799 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:59:08.459799 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:59:08.459799 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:59:08.459799 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d could not be found. Jun 17 08:59:08.459799 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:08.459799 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:08.459799 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:08.459799 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:08.459799 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:08.459799 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:08.459799 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:59:08.459799 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:59:08.459799 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d could not be found. Jun 17 08:59:08.459799 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:08.461847 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-119298b8-4508-465f-8cfc-878cab77ea49 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Returning 404 to user: Instance 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:59:08.461847 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-119298b8-4508-465f-8cfc-878cab77ea49 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 404 len: 111 microversion: 2.1 time: 0.032060 Jun 17 08:59:08.461847 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 501/1009] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 08:59:08 2022] DELETE /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:59:08.466571 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-15c067d7-eaa1-4545-9fec-1db5f1e83a1f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:08.467842 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-15c067d7-eaa1-4545-9fec-1db5f1e83a1f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:08.475034 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-15c067d7-eaa1-4545-9fec-1db5f1e83a1f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:08.475530 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-15c067d7-eaa1-4545-9fec-1db5f1e83a1f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:08.476310 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-15c067d7-eaa1-4545-9fec-1db5f1e83a1f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:08.476755 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-15c067d7-eaa1-4545-9fec-1db5f1e83a1f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:08.491363 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-15c067d7-eaa1-4545-9fec-1db5f1e83a1f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] HTTP exception thrown: Instance 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d could not be found. Jun 17 08:59:08.493023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-15c067d7-eaa1-4545-9fec-1db5f1e83a1f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Request method failure captured: Jun 17 08:59:08.493023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d HTTP/1.1 Jun 17 08:59:08.493023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:59:08.493023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:59:08.493023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:59:08.493023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 08:59:08.493023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:59:08.493023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:59:08.493023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:59:08.493023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:59:08.493023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirECoefK_2BxjZgVOeODeD0JulOcw4b3dCrWlpFY_cQoAEUxcK30AdtBELaLH-kVfcQ6VKJx7aLTz7Z0L639CzJLSrkIUHMaE3fnQwSThKfCgM9dozYdAIITDcNAYtXkDc4HYT-B7uJX_QV7RNcl_PdXigEFPXJ9IRk3STBItMRTcdRI Jun 17 08:59:08.493023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:59:08.493023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:59:08.493023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:59:08.493023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:59:08.493023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:59:08.493023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:59:08.493023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:59:08.493023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:08.493023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:59:08.493023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:59:08.497519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}] Jun 17 08:59:08.497519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:08.497519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:59:08.497519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:08.497519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:59:08.497519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:59:08.497519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:59:08.497519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: 01bb3df8b4b649388d1a0f6c24e18f1b Jun 17 08:59:08.497519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:59:08.497519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 08:59:08.497519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Instance 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d could not be found. Jun 17 08:59:08.497519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'id': '4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d'} Jun 17 08:59:08.498478 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:59:08.498478 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:08.498478 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:59:08.498478 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:59:08.498478 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:59:08.498478 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:59:08.498478 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:59:08.498478 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:59:08.498478 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:59:08.498478 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:59:08.498478 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d could not be found. Jun 17 08:59:08.498478 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:08.498478 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:08.498478 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:08.498478 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:08.498478 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:08.498478 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:08.498478 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:59:08.498478 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:59:08.498478 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:59:08.499987 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:59:08.499987 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:59:08.499987 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:59:08.499987 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:59:08.499987 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:59:08.499987 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:59:08.499987 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:59:08.499987 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d could not be found. Jun 17 08:59:08.499987 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:08.499987 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:08.499987 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:08.499987 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:08.499987 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:08.499987 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:08.499987 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:59:08.499987 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:59:08.499987 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d could not be found. Jun 17 08:59:08.499987 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:08.501358 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-15c067d7-eaa1-4545-9fec-1db5f1e83a1f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Returning 404 to user: Instance 4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d could not be found. {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:59:08.501358 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-15c067d7-eaa1-4545-9fec-1db5f1e83a1f tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d" status: 404 len: 111 microversion: 2.1 time: 0.031909 Jun 17 08:59:08.501358 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 509/1010] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:08 2022] GET /compute/v2.1/servers/4e49453a-3b44-4d0a-8cb5-b6ecb2bf0f4d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:59:09.846549 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-dd08b477-7ea4-4d0e-9472-8b81b176d836 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:09.847101 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-dd08b477-7ea4-4d0e-9472-8b81b176d836 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:09.853582 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-dd08b477-7ea4-4d0e-9472-8b81b176d836 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:09.857115 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-dd08b477-7ea4-4d0e-9472-8b81b176d836 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:09.857115 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-dd08b477-7ea4-4d0e-9472-8b81b176d836 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:09.857115 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-dd08b477-7ea4-4d0e-9472-8b81b176d836 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:09.871418 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-dd08b477-7ea4-4d0e-9472-8b81b176d836 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] HTTP exception thrown: Instance 42469758-d2b8-4bde-92f6-0b7ef5528fbc could not be found. Jun 17 08:59:09.872974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-dd08b477-7ea4-4d0e-9472-8b81b176d836 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Request method failure captured: Jun 17 08:59:09.872974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: DELETE /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc HTTP/1.1 Jun 17 08:59:09.872974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 08:59:09.872974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 08:59:09.872974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 08:59:09.872974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 08:59:09.872974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 08:59:09.872974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 08:59:09.872974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 08:59:09.872974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 08:59:09.872974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirECoefK_2BxjZgVOeODeD0JulOcw4b3dCrWlpFY_cQoAEUxcK30AdtBELaLH-kVfcQ6VKJx7aLTz7Z0L639CzJLSrkIUHMaE3fnQwSThKfCgM9dozYdAIITDcNAYtXkDc4HYT-B7uJX_QV7RNcl_PdXigEFPXJ9IRk3STBItMRTcdRI Jun 17 08:59:09.872974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 08:59:09.872974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 08:59:09.872974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 08:59:09.872974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 08:59:09.872974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 08:59:09.872974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 08:59:09.872974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:59:09.872974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:09.872974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 08:59:09.872974 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 08:59:09.874588 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}] Jun 17 08:59:09.874588 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:09.874588 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:59:09.874588 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:09.874588 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:59:09.874588 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 08:59:09.874588 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 08:59:09.874588 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: 01bb3df8b4b649388d1a0f6c24e18f1b Jun 17 08:59:09.874588 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:59:09.874588 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: > Jun 17 08:59:09.874588 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Instance 42469758-d2b8-4bde-92f6-0b7ef5528fbc could not be found. Jun 17 08:59:09.874588 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'id': '42469758-d2b8-4bde-92f6-0b7ef5528fbc'} Jun 17 08:59:09.876330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:59:09.876330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:09.876330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:59:09.876330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:59:09.876330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:59:09.876330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:59:09.876330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:59:09.876330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:59:09.876330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:59:09.876330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:59:09.876330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42469758-d2b8-4bde-92f6-0b7ef5528fbc could not be found. Jun 17 08:59:09.876330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:09.876330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:09.876330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:09.876330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:09.876330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:09.876330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:09.876330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:59:09.876330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:59:09.876330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:59:09.877976 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:59:09.877976 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 08:59:09.877976 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 08:59:09.877976 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 08:59:09.877976 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 08:59:09.877976 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:59:09.877976 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:59:09.877976 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:59:09.877976 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:59:09.877976 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42469758-d2b8-4bde-92f6-0b7ef5528fbc could not be found. Jun 17 08:59:09.877976 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:09.877976 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:09.877976 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:09.877976 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:09.877976 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:09.877976 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:09.877976 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:59:09.877976 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:59:09.877976 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42469758-d2b8-4bde-92f6-0b7ef5528fbc could not be found. Jun 17 08:59:09.877976 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:09.879585 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-dd08b477-7ea4-4d0e-9472-8b81b176d836 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Returning 404 to user: Instance 42469758-d2b8-4bde-92f6-0b7ef5528fbc could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:59:09.879585 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-dd08b477-7ea4-4d0e-9472-8b81b176d836 tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "DELETE /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 404 len: 111 microversion: 2.1 time: 0.031709 Jun 17 08:59:09.879585 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 502/1011] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 08:59:09 2022] DELETE /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:59:09.884741 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-fab62845-a41c-49e5-a92e-af73acdc079a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:09.885360 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-fab62845-a41c-49e5-a92e-af73acdc079a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] [instance: 42469758-d2b8-4bde-92f6-0b7ef5528fbc] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:09.891917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fab62845-a41c-49e5-a92e-af73acdc079a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:09.892365 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fab62845-a41c-49e5-a92e-af73acdc079a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:09.893135 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fab62845-a41c-49e5-a92e-af73acdc079a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:09.893569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fab62845-a41c-49e5-a92e-af73acdc079a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:09.907321 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-fab62845-a41c-49e5-a92e-af73acdc079a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] HTTP exception thrown: Instance 42469758-d2b8-4bde-92f6-0b7ef5528fbc could not be found. Jun 17 08:59:09.908973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-fab62845-a41c-49e5-a92e-af73acdc079a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Request method failure captured: Jun 17 08:59:09.908973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc HTTP/1.1 Jun 17 08:59:09.908973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:59:09.908973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:59:09.908973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:59:09.908973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 08:59:09.908973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:59:09.908973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:59:09.908973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:59:09.908973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:59:09.908973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirECoefK_2BxjZgVOeODeD0JulOcw4b3dCrWlpFY_cQoAEUxcK30AdtBELaLH-kVfcQ6VKJx7aLTz7Z0L639CzJLSrkIUHMaE3fnQwSThKfCgM9dozYdAIITDcNAYtXkDc4HYT-B7uJX_QV7RNcl_PdXigEFPXJ9IRk3STBItMRTcdRI Jun 17 08:59:09.908973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:59:09.908973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:59:09.908973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:59:09.908973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:59:09.908973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:59:09.908973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:59:09.908973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:59:09.908973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:09.908973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:59:09.908973 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:59:09.914284 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_794e7ebcf5c3436081b8e8d39907b655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/794e7ebcf5c3436081b8e8d39907b655"}]}] Jun 17 08:59:09.914284 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:09.914284 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: 794e7ebcf5c3436081b8e8d39907b655 Jun 17 08:59:09.914284 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879905796 Jun 17 08:59:09.914284 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:59:09.914284 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:59:09.914284 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:59:09.914284 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: 01bb3df8b4b649388d1a0f6c24e18f1b Jun 17 08:59:09.914284 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-AttachVolumeNegativeTest-1879905796-project Jun 17 08:59:09.914284 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 08:59:09.914284 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Instance 42469758-d2b8-4bde-92f6-0b7ef5528fbc could not be found. Jun 17 08:59:09.914284 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'id': '42469758-d2b8-4bde-92f6-0b7ef5528fbc'} Jun 17 08:59:09.915170 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:59:09.915170 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:09.915170 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:59:09.915170 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:59:09.915170 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:59:09.915170 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:59:09.915170 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:59:09.915170 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:59:09.915170 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:59:09.915170 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:59:09.915170 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42469758-d2b8-4bde-92f6-0b7ef5528fbc could not be found. Jun 17 08:59:09.915170 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:09.915170 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:09.915170 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:09.915170 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:09.915170 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:09.915170 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:09.915170 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:59:09.915170 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:59:09.915170 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:59:09.917121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:59:09.917121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:59:09.917121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:59:09.917121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:59:09.917121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:59:09.917121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:59:09.917121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:59:09.917121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42469758-d2b8-4bde-92f6-0b7ef5528fbc could not be found. Jun 17 08:59:09.917121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:09.917121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:09.917121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:09.917121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:09.917121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:09.917121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:09.917121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:59:09.917121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:59:09.917121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42469758-d2b8-4bde-92f6-0b7ef5528fbc could not be found. Jun 17 08:59:09.917121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:09.918408 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-fab62845-a41c-49e5-a92e-af73acdc079a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] Returning 404 to user: Instance 42469758-d2b8-4bde-92f6-0b7ef5528fbc could not be found. {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:59:09.918408 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-fab62845-a41c-49e5-a92e-af73acdc079a tempest-AttachVolumeNegativeTest-1879905796 tempest-AttachVolumeNegativeTest-1879905796-project] 10.222.0.78 "GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc" status: 404 len: 111 microversion: 2.1 time: 0.030173 Jun 17 08:59:09.918408 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 510/1012] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:09 2022] GET /compute/v2.1/servers/42469758-d2b8-4bde-92f6-0b7ef5528fbc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:59:23.556472 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-fd8ef9fe-2352-4c69-a9c3-6d454ef235e3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:23.557399 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-fd8ef9fe-2352-4c69-a9c3-6d454ef235e3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:23.560250 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:23.560978 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:23.566087 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fd8ef9fe-2352-4c69-a9c3-6d454ef235e3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:23.566547 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fd8ef9fe-2352-4c69-a9c3-6d454ef235e3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:23.567380 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fd8ef9fe-2352-4c69-a9c3-6d454ef235e3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:23.567835 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-fd8ef9fe-2352-4c69-a9c3-6d454ef235e3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:23.599375 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-fd8ef9fe-2352-4c69-a9c3-6d454ef235e3 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047075 Jun 17 08:59:23.599971 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 503/1013] 10.222.0.78 () {60 vars in 1342 bytes} [Fri Jun 17 08:59:23 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:59:23.660056 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a740e298-f187-4337-a55a-466ee40054cc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:23.660691 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a740e298-f187-4337-a55a-466ee40054cc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:23.663115 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:23.663876 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=76 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:23.668855 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a740e298-f187-4337-a55a-466ee40054cc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:23.669536 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a740e298-f187-4337-a55a-466ee40054cc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:23.670367 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a740e298-f187-4337-a55a-466ee40054cc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:23.674611 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a740e298-f187-4337-a55a-466ee40054cc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:23.697980 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a740e298-f187-4337-a55a-466ee40054cc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Going to try to terminate instance {{(pid=129876) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:59:24.020056 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a740e298-f187-4337-a55a-466ee40054cc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 204 len: 0 microversion: 2.20 time: 0.363155 Jun 17 08:59:24.020056 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 511/1014] 10.222.0.78 () {60 vars in 1279 bytes} [Fri Jun 17 08:59:23 2022] DELETE /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 08:59:24.028877 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-cd3d1cb3-0266-48f4-89ff-afbb9e55988f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:24.029615 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-cd3d1cb3-0266-48f4-89ff-afbb9e55988f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:24.037529 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-cd3d1cb3-0266-48f4-89ff-afbb9e55988f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:24.037970 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-cd3d1cb3-0266-48f4-89ff-afbb9e55988f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:24.038881 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-cd3d1cb3-0266-48f4-89ff-afbb9e55988f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:24.039236 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-cd3d1cb3-0266-48f4-89ff-afbb9e55988f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:24.184244 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-cd3d1cb3-0266-48f4-89ff-afbb9e55988f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:24.193913 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-cd3d1cb3-0266-48f4-89ff-afbb9e55988f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:24.195550 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-cd3d1cb3-0266-48f4-89ff-afbb9e55988f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:24.196807 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-cd3d1cb3-0266-48f4-89ff-afbb9e55988f tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1722 microversion: 2.20 time: 0.172379 Jun 17 08:59:24.197379 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 504/1015] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:59:24 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:59:25.216389 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-c6296aa3-4ee2-471c-a52b-db0384969fea tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:25.217012 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-c6296aa3-4ee2-471c-a52b-db0384969fea tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:25.223631 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c6296aa3-4ee2-471c-a52b-db0384969fea tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:25.224089 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c6296aa3-4ee2-471c-a52b-db0384969fea tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:25.224862 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c6296aa3-4ee2-471c-a52b-db0384969fea tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:25.225301 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c6296aa3-4ee2-471c-a52b-db0384969fea tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:25.361413 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c6296aa3-4ee2-471c-a52b-db0384969fea tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:25.369826 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c6296aa3-4ee2-471c-a52b-db0384969fea tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:25.371310 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c6296aa3-4ee2-471c-a52b-db0384969fea tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:25.372500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-c6296aa3-4ee2-471c-a52b-db0384969fea tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1722 microversion: 2.20 time: 0.160780 Jun 17 08:59:25.373070 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 512/1016] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:59:25 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:59:26.394089 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-80df22fe-b978-481e-85ac-952bb154bb84 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:26.395425 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-80df22fe-b978-481e-85ac-952bb154bb84 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:26.406663 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-80df22fe-b978-481e-85ac-952bb154bb84 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:26.407414 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-80df22fe-b978-481e-85ac-952bb154bb84 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:26.408528 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-80df22fe-b978-481e-85ac-952bb154bb84 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:26.412608 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-80df22fe-b978-481e-85ac-952bb154bb84 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:26.429424 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-579bf1ec-2fd3-40ae-97be-1f9b9a661d99 req-4378b7db-fc7e-40e4-9640-9ab6d7f1cd61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b18a4b5-273d-4ec1-81a8-ca670de385ea", "name": "network-vif-deleted", "tag": "02d2e50f-49e7-4067-86ed-da24c07d5aea"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:59:26.446449 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-579bf1ec-2fd3-40ae-97be-1f9b9a661d99 req-4378b7db-fc7e-40e4-9640-9ab6d7f1cd61 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:26.446984 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-579bf1ec-2fd3-40ae-97be-1f9b9a661d99 req-4378b7db-fc7e-40e4-9640-9ab6d7f1cd61 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:26.463187 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-579bf1ec-2fd3-40ae-97be-1f9b9a661d99 req-4378b7db-fc7e-40e4-9640-9ab6d7f1cd61 service nova] Creating event network-vif-deleted:02d2e50f-49e7-4067-86ed-da24c07d5aea for instance 2b18a4b5-273d-4ec1-81a8-ca670de385ea on hv-cinder-79760 Jun 17 08:59:26.470099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-579bf1ec-2fd3-40ae-97be-1f9b9a661d99 req-4378b7db-fc7e-40e4-9640-9ab6d7f1cd61 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048668 Jun 17 08:59:26.471573 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 513/1017] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:59:26.509230 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-80df22fe-b978-481e-85ac-952bb154bb84 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:26.519190 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-80df22fe-b978-481e-85ac-952bb154bb84 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:26.521008 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-80df22fe-b978-481e-85ac-952bb154bb84 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:26.522223 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-80df22fe-b978-481e-85ac-952bb154bb84 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1655 microversion: 2.20 time: 0.133850 Jun 17 08:59:26.522779 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 505/1018] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:59:26 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1655 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:59:27.541038 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-04ae528a-3c2d-4061-9092-25ee1f6167fc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:27.541783 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-04ae528a-3c2d-4061-9092-25ee1f6167fc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:27.548772 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-04ae528a-3c2d-4061-9092-25ee1f6167fc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:27.549226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-04ae528a-3c2d-4061-9092-25ee1f6167fc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:27.550025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-04ae528a-3c2d-4061-9092-25ee1f6167fc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:27.550502 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-04ae528a-3c2d-4061-9092-25ee1f6167fc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:27.620371 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-04ae528a-3c2d-4061-9092-25ee1f6167fc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:27.628719 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-04ae528a-3c2d-4061-9092-25ee1f6167fc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:27.630231 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-04ae528a-3c2d-4061-9092-25ee1f6167fc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:27.631426 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-04ae528a-3c2d-4061-9092-25ee1f6167fc tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1655 microversion: 2.20 time: 0.094654 Jun 17 08:59:27.631969 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 514/1019] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:59:27 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1655 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:59:28.649034 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d055034c-1194-41db-a9d8-344b1de90e11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:28.649632 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-d055034c-1194-41db-a9d8-344b1de90e11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:28.657032 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d055034c-1194-41db-a9d8-344b1de90e11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:28.657487 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d055034c-1194-41db-a9d8-344b1de90e11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:28.658265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d055034c-1194-41db-a9d8-344b1de90e11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:28.658711 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d055034c-1194-41db-a9d8-344b1de90e11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:28.691154 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d055034c-1194-41db-a9d8-344b1de90e11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:28.691703 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d055034c-1194-41db-a9d8-344b1de90e11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:28.692158 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-d055034c-1194-41db-a9d8-344b1de90e11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lazy-loading 'fault' on Instance uuid 2b18a4b5-273d-4ec1-81a8-ca670de385ea {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:59:28.731570 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d055034c-1194-41db-a9d8-344b1de90e11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:28.740285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d055034c-1194-41db-a9d8-344b1de90e11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:28.741823 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d055034c-1194-41db-a9d8-344b1de90e11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eb46b0aeeb46fe8dcdb02f29ae4013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:28.743111 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-d055034c-1194-41db-a9d8-344b1de90e11 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 200 len: 1371 microversion: 2.20 time: 0.097909 Jun 17 08:59:28.743705 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 506/1020] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:59:28 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:59:29.761896 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-d13ff4a7-34af-405e-9494-ab593a077872 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:29.762518 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-d13ff4a7-34af-405e-9494-ab593a077872 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:29.770279 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d13ff4a7-34af-405e-9494-ab593a077872 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:29.770767 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d13ff4a7-34af-405e-9494-ab593a077872 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:29.771584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d13ff4a7-34af-405e-9494-ab593a077872 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:29.772023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d13ff4a7-34af-405e-9494-ab593a077872 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:29.786523 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-d13ff4a7-34af-405e-9494-ab593a077872 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] HTTP exception thrown: Instance 2b18a4b5-273d-4ec1-81a8-ca670de385ea could not be found. Jun 17 08:59:29.788372 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-d13ff4a7-34af-405e-9494-ab593a077872 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Request method failure captured: Jun 17 08:59:29.788372 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea HTTP/1.1 Jun 17 08:59:29.788372 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:59:29.788372 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:59:29.788372 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:59:29.788372 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 08:59:29.788372 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:59:29.788372 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:59:29.788372 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:59:29.788372 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:59:29.788372 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirECpO4HU2x-T5tTPcpP_G91Ta42vbNddPWYj9UNOGh7dCt7rCs7Pv61pFmj2vJdKVpqOk2RI8b4DPp9aauMdSVkosSGW7qQUabZMh2mwq7th2LcTqx_JDY72sQeakoMZNPX0YEvJmTwi5Zi8i6sBKL2AhN8jsUF9RFfXgg1PSB-5Y8Q Jun 17 08:59:29.788372 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:59:29.788372 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:59:29.788372 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:59:29.788372 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:59:29.788372 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 08:59:29.788372 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:59:29.788372 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:59:29.788372 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: b493dbf75ed64a7dbda3e9c6a6168f8f Jun 17 08:59:29.788372 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1501423591 Jun 17 08:59:29.788372 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:59:29.788372 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:59:29.790087 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b493dbf75ed64a7dbda3e9c6a6168f8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b493dbf75ed64a7dbda3e9c6a6168f8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b493dbf75ed64a7dbda3e9c6a6168f8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b493dbf75ed64a7dbda3e9c6a6168f8f"}]}] Jun 17 08:59:29.790087 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1501423591 Jun 17 08:59:29.790087 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: b493dbf75ed64a7dbda3e9c6a6168f8f Jun 17 08:59:29.790087 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1501423591 Jun 17 08:59:29.790087 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-AttachVolumeShelveTestJSON-1501423591-project Jun 17 08:59:29.790087 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:59:29.790087 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:59:29.790087 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: b0eb46b0aeeb46fe8dcdb02f29ae4013 Jun 17 08:59:29.790087 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1501423591-project Jun 17 08:59:29.790087 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 08:59:29.790087 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Instance 2b18a4b5-273d-4ec1-81a8-ca670de385ea could not be found. Jun 17 08:59:29.790087 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'id': '2b18a4b5-273d-4ec1-81a8-ca670de385ea'} Jun 17 08:59:29.790902 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:59:29.790902 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:29.790902 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:59:29.790902 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:59:29.790902 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:59:29.790902 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:59:29.790902 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:59:29.790902 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:59:29.790902 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:59:29.790902 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:59:29.790902 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b18a4b5-273d-4ec1-81a8-ca670de385ea could not be found. Jun 17 08:59:29.790902 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:29.790902 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:29.790902 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:29.790902 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:29.790902 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:29.790902 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:29.790902 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:59:29.790902 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:59:29.790902 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:59:29.792226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:59:29.792226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:59:29.792226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:59:29.792226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:59:29.792226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:59:29.792226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:59:29.792226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:59:29.792226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b18a4b5-273d-4ec1-81a8-ca670de385ea could not be found. Jun 17 08:59:29.792226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:29.792226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:29.792226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:29.792226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:29.792226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:29.792226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:29.792226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:59:29.792226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:59:29.792226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b18a4b5-273d-4ec1-81a8-ca670de385ea could not be found. Jun 17 08:59:29.792226 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:29.793360 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-d13ff4a7-34af-405e-9494-ab593a077872 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Returning 404 to user: Instance 2b18a4b5-273d-4ec1-81a8-ca670de385ea could not be found. {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:59:29.793360 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-d13ff4a7-34af-405e-9494-ab593a077872 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 404 len: 111 microversion: 2.20 time: 0.031937 Jun 17 08:59:29.793360 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 515/1021] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:59:29 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 08:59:29.798971 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-84573302-221b-4a42-a728-72a13e2238f4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '.version_select at 0x7fbc40342e50>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:29.898793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-84573302-221b-4a42-a728-72a13e2238f4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1282411073" status: 204 len: 0 microversion: 2.20 time: 0.103915 Jun 17 08:59:29.900018 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 507/1022] 10.222.0.78 () {60 vars in 1261 bytes} [Fri Jun 17 08:59:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1282411073 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 08:59:32.087949 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e9da1d0c-9193-4c2f-85a1-1399117268ed tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:32.088475 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-e9da1d0c-9193-4c2f-85a1-1399117268ed tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:32.095679 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e9da1d0c-9193-4c2f-85a1-1399117268ed tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:32.096129 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e9da1d0c-9193-4c2f-85a1-1399117268ed tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:32.097075 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e9da1d0c-9193-4c2f-85a1-1399117268ed tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:32.097511 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e9da1d0c-9193-4c2f-85a1-1399117268ed tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:32.112525 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-e9da1d0c-9193-4c2f-85a1-1399117268ed tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] HTTP exception thrown: Instance 2b18a4b5-273d-4ec1-81a8-ca670de385ea could not be found. Jun 17 08:59:32.114099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e9da1d0c-9193-4c2f-85a1-1399117268ed tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Request method failure captured: Jun 17 08:59:32.114099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: DELETE /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea HTTP/1.1 Jun 17 08:59:32.114099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:59:32.114099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:59:32.114099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:59:32.114099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 08:59:32.114099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:59:32.114099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:59:32.114099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:59:32.114099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:59:32.114099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirECpO4HU2x-T5tTPcpP_G91Ta42vbNddPWYj9UNOGh7dCt7rCs7Pv61pFmj2vJdKVpqOk2RI8b4DPp9aauMdSVkosSGW7qQUabZMh2mwq7th2LcTqx_JDY72sQeakoMZNPX0YEvJmTwi5Zi8i6sBKL2AhN8jsUF9RFfXgg1PSB-5Y8Q Jun 17 08:59:32.114099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:59:32.114099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:59:32.114099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:59:32.114099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:59:32.114099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 08:59:32.114099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:59:32.114099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:59:32.114099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: b493dbf75ed64a7dbda3e9c6a6168f8f Jun 17 08:59:32.114099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1501423591 Jun 17 08:59:32.114099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:59:32.114099 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:59:32.118637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b493dbf75ed64a7dbda3e9c6a6168f8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b493dbf75ed64a7dbda3e9c6a6168f8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b493dbf75ed64a7dbda3e9c6a6168f8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b493dbf75ed64a7dbda3e9c6a6168f8f"}]}] Jun 17 08:59:32.118637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1501423591 Jun 17 08:59:32.118637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: b493dbf75ed64a7dbda3e9c6a6168f8f Jun 17 08:59:32.118637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1501423591 Jun 17 08:59:32.118637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-AttachVolumeShelveTestJSON-1501423591-project Jun 17 08:59:32.118637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:59:32.118637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:59:32.118637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: b0eb46b0aeeb46fe8dcdb02f29ae4013 Jun 17 08:59:32.118637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1501423591-project Jun 17 08:59:32.118637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 08:59:32.118637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Instance 2b18a4b5-273d-4ec1-81a8-ca670de385ea could not be found. Jun 17 08:59:32.118637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'id': '2b18a4b5-273d-4ec1-81a8-ca670de385ea'} Jun 17 08:59:32.119433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:59:32.119433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:32.119433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:59:32.119433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:59:32.119433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:59:32.119433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:59:32.119433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:59:32.119433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:59:32.119433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:59:32.119433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:59:32.119433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b18a4b5-273d-4ec1-81a8-ca670de385ea could not be found. Jun 17 08:59:32.119433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:32.119433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:32.119433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:32.119433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:32.119433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:32.119433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:32.119433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:59:32.119433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:59:32.119433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:59:32.120846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:59:32.120846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 08:59:32.120846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 08:59:32.120846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 08:59:32.120846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 08:59:32.120846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:59:32.120846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:59:32.120846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:59:32.120846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:59:32.120846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b18a4b5-273d-4ec1-81a8-ca670de385ea could not be found. Jun 17 08:59:32.120846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:32.120846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:32.120846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:32.120846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:32.120846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:32.120846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:32.120846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:59:32.120846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:59:32.120846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b18a4b5-273d-4ec1-81a8-ca670de385ea could not be found. Jun 17 08:59:32.120846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:32.122275 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e9da1d0c-9193-4c2f-85a1-1399117268ed tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Returning 404 to user: Instance 2b18a4b5-273d-4ec1-81a8-ca670de385ea could not be found. {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:59:32.122275 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-e9da1d0c-9193-4c2f-85a1-1399117268ed tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 404 len: 111 microversion: 2.20 time: 0.031788 Jun 17 08:59:32.122275 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 516/1023] 10.222.0.78 () {60 vars in 1279 bytes} [Fri Jun 17 08:59:32 2022] DELETE /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 08:59:32.128535 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-f9337b49-4032-4861-8a5b-c313cdd5d23c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:32.129168 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-f9337b49-4032-4861-8a5b-c313cdd5d23c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 2b18a4b5-273d-4ec1-81a8-ca670de385ea] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:32.136274 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f9337b49-4032-4861-8a5b-c313cdd5d23c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:32.136807 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f9337b49-4032-4861-8a5b-c313cdd5d23c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:32.137704 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f9337b49-4032-4861-8a5b-c313cdd5d23c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:32.138220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f9337b49-4032-4861-8a5b-c313cdd5d23c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:32.154512 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-f9337b49-4032-4861-8a5b-c313cdd5d23c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] HTTP exception thrown: Instance 2b18a4b5-273d-4ec1-81a8-ca670de385ea could not be found. Jun 17 08:59:32.156184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-f9337b49-4032-4861-8a5b-c313cdd5d23c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Request method failure captured: Jun 17 08:59:32.156184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea HTTP/1.1 Jun 17 08:59:32.156184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 08:59:32.156184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 08:59:32.156184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 08:59:32.156184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 08:59:32.156184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 08:59:32.156184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 08:59:32.156184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 08:59:32.156184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 08:59:32.156184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirECpO4HU2x-T5tTPcpP_G91Ta42vbNddPWYj9UNOGh7dCt7rCs7Pv61pFmj2vJdKVpqOk2RI8b4DPp9aauMdSVkosSGW7qQUabZMh2mwq7th2LcTqx_JDY72sQeakoMZNPX0YEvJmTwi5Zi8i6sBKL2AhN8jsUF9RFfXgg1PSB-5Y8Q Jun 17 08:59:32.156184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 08:59:32.156184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 08:59:32.156184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 08:59:32.156184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 08:59:32.156184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 08:59:32.156184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 08:59:32.156184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 08:59:32.156184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: b493dbf75ed64a7dbda3e9c6a6168f8f Jun 17 08:59:32.156184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1501423591 Jun 17 08:59:32.156184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 08:59:32.156184 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 08:59:32.157651 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b493dbf75ed64a7dbda3e9c6a6168f8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b493dbf75ed64a7dbda3e9c6a6168f8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b493dbf75ed64a7dbda3e9c6a6168f8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b493dbf75ed64a7dbda3e9c6a6168f8f"}]}] Jun 17 08:59:32.157651 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1501423591 Jun 17 08:59:32.157651 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: b493dbf75ed64a7dbda3e9c6a6168f8f Jun 17 08:59:32.157651 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1501423591 Jun 17 08:59:32.157651 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-AttachVolumeShelveTestJSON-1501423591-project Jun 17 08:59:32.157651 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 08:59:32.157651 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 08:59:32.157651 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: b0eb46b0aeeb46fe8dcdb02f29ae4013 Jun 17 08:59:32.157651 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1501423591-project Jun 17 08:59:32.157651 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: > Jun 17 08:59:32.157651 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Instance 2b18a4b5-273d-4ec1-81a8-ca670de385ea could not be found. Jun 17 08:59:32.157651 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'id': '2b18a4b5-273d-4ec1-81a8-ca670de385ea'} Jun 17 08:59:32.158499 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:59:32.158499 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:32.158499 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:59:32.158499 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:59:32.158499 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:59:32.158499 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:59:32.158499 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:59:32.158499 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:59:32.158499 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:59:32.158499 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:59:32.158499 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b18a4b5-273d-4ec1-81a8-ca670de385ea could not be found. Jun 17 08:59:32.158499 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:32.158499 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:32.158499 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:32.158499 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:32.158499 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:32.158499 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:32.158499 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:59:32.158499 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:59:32.158499 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:59:32.160474 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:59:32.160474 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:59:32.160474 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:59:32.160474 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:59:32.160474 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:59:32.160474 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:59:32.160474 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:59:32.160474 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b18a4b5-273d-4ec1-81a8-ca670de385ea could not be found. Jun 17 08:59:32.160474 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:32.160474 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:32.160474 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:32.160474 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:32.160474 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:32.160474 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:32.160474 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:59:32.160474 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:59:32.160474 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b18a4b5-273d-4ec1-81a8-ca670de385ea could not be found. Jun 17 08:59:32.160474 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:32.161785 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-f9337b49-4032-4861-8a5b-c313cdd5d23c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Returning 404 to user: Instance 2b18a4b5-273d-4ec1-81a8-ca670de385ea could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:59:32.161785 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-f9337b49-4032-4861-8a5b-c313cdd5d23c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea" status: 404 len: 111 microversion: 2.20 time: 0.033974 Jun 17 08:59:32.161785 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 508/1024] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:59:32 2022] GET /compute/v2.1/servers/2b18a4b5-273d-4ec1-81a8-ca670de385ea => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 08:59:33.462721 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-7854b2ae-08a5-44f9-b7af-c56df07e10f4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:33.463482 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-7854b2ae-08a5-44f9-b7af-c56df07e10f4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:33.472328 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7854b2ae-08a5-44f9-b7af-c56df07e10f4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:33.479455 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7854b2ae-08a5-44f9-b7af-c56df07e10f4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:33.479455 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7854b2ae-08a5-44f9-b7af-c56df07e10f4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:33.479455 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7854b2ae-08a5-44f9-b7af-c56df07e10f4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:33.490208 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-7854b2ae-08a5-44f9-b7af-c56df07e10f4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] HTTP exception thrown: Instance 397d996b-b163-4a47-856e-f2aca2ae6976 could not be found. Jun 17 08:59:33.492263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-7854b2ae-08a5-44f9-b7af-c56df07e10f4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Request method failure captured: Jun 17 08:59:33.492263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: DELETE /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 HTTP/1.1 Jun 17 08:59:33.492263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:59:33.492263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:59:33.492263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:59:33.492263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 08:59:33.492263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:59:33.492263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:59:33.492263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:59:33.492263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:59:33.492263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirECpO4HU2x-T5tTPcpP_G91Ta42vbNddPWYj9UNOGh7dCt7rCs7Pv61pFmj2vJdKVpqOk2RI8b4DPp9aauMdSVkosSGW7qQUabZMh2mwq7th2LcTqx_JDY72sQeakoMZNPX0YEvJmTwi5Zi8i6sBKL2AhN8jsUF9RFfXgg1PSB-5Y8Q Jun 17 08:59:33.492263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:59:33.492263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:59:33.492263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:59:33.492263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:59:33.492263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 08:59:33.492263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:59:33.492263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:59:33.492263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: b493dbf75ed64a7dbda3e9c6a6168f8f Jun 17 08:59:33.492263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1501423591 Jun 17 08:59:33.492263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:59:33.492263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:59:33.493823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b493dbf75ed64a7dbda3e9c6a6168f8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b493dbf75ed64a7dbda3e9c6a6168f8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b493dbf75ed64a7dbda3e9c6a6168f8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b493dbf75ed64a7dbda3e9c6a6168f8f"}]}] Jun 17 08:59:33.493823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1501423591 Jun 17 08:59:33.493823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: b493dbf75ed64a7dbda3e9c6a6168f8f Jun 17 08:59:33.493823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1501423591 Jun 17 08:59:33.493823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-AttachVolumeShelveTestJSON-1501423591-project Jun 17 08:59:33.493823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:59:33.493823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:59:33.493823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: b0eb46b0aeeb46fe8dcdb02f29ae4013 Jun 17 08:59:33.493823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1501423591-project Jun 17 08:59:33.493823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 08:59:33.493823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Instance 397d996b-b163-4a47-856e-f2aca2ae6976 could not be found. Jun 17 08:59:33.493823 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'id': '397d996b-b163-4a47-856e-f2aca2ae6976'} Jun 17 08:59:33.494714 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:59:33.494714 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:33.494714 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:59:33.494714 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:59:33.494714 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:59:33.494714 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:59:33.494714 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:59:33.494714 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:59:33.494714 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:59:33.494714 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:59:33.494714 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 397d996b-b163-4a47-856e-f2aca2ae6976 could not be found. Jun 17 08:59:33.494714 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:33.494714 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:33.494714 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:33.494714 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:33.494714 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:33.494714 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:33.494714 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:59:33.494714 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:59:33.494714 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:59:33.496332 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:59:33.496332 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 08:59:33.496332 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 08:59:33.496332 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 08:59:33.496332 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 08:59:33.496332 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:59:33.496332 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:59:33.496332 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:59:33.496332 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:59:33.496332 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 397d996b-b163-4a47-856e-f2aca2ae6976 could not be found. Jun 17 08:59:33.496332 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:33.496332 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:33.496332 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:33.496332 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:33.496332 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:33.496332 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:33.496332 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:59:33.496332 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:59:33.496332 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 397d996b-b163-4a47-856e-f2aca2ae6976 could not be found. Jun 17 08:59:33.496332 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:33.497869 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-7854b2ae-08a5-44f9-b7af-c56df07e10f4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Returning 404 to user: Instance 397d996b-b163-4a47-856e-f2aca2ae6976 could not be found. {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:59:33.497869 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-7854b2ae-08a5-44f9-b7af-c56df07e10f4 tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "DELETE /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 404 len: 111 microversion: 2.20 time: 0.035878 Jun 17 08:59:33.503726 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-554e9bbf-57b9-438a-b47e-9820e096645c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:33.504337 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-554e9bbf-57b9-438a-b47e-9820e096645c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] [instance: 397d996b-b163-4a47-856e-f2aca2ae6976] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:33.507152 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 517/1025] 10.222.0.78 () {60 vars in 1279 bytes} [Fri Jun 17 08:59:33 2022] DELETE /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 08:59:33.513090 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-554e9bbf-57b9-438a-b47e-9820e096645c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:33.515619 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-554e9bbf-57b9-438a-b47e-9820e096645c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:33.515921 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-554e9bbf-57b9-438a-b47e-9820e096645c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:33.516541 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-554e9bbf-57b9-438a-b47e-9820e096645c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:33.531973 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-554e9bbf-57b9-438a-b47e-9820e096645c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] HTTP exception thrown: Instance 397d996b-b163-4a47-856e-f2aca2ae6976 could not be found. Jun 17 08:59:33.533551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-554e9bbf-57b9-438a-b47e-9820e096645c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Request method failure captured: Jun 17 08:59:33.533551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 HTTP/1.1 Jun 17 08:59:33.533551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 08:59:33.533551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 08:59:33.533551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 08:59:33.533551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 08:59:33.533551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 08:59:33.533551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 08:59:33.533551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 08:59:33.533551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 08:59:33.533551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirECpO4HU2x-T5tTPcpP_G91Ta42vbNddPWYj9UNOGh7dCt7rCs7Pv61pFmj2vJdKVpqOk2RI8b4DPp9aauMdSVkosSGW7qQUabZMh2mwq7th2LcTqx_JDY72sQeakoMZNPX0YEvJmTwi5Zi8i6sBKL2AhN8jsUF9RFfXgg1PSB-5Y8Q Jun 17 08:59:33.533551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 08:59:33.533551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 08:59:33.533551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 08:59:33.533551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 08:59:33.533551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 08:59:33.533551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 08:59:33.533551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 08:59:33.533551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: b493dbf75ed64a7dbda3e9c6a6168f8f Jun 17 08:59:33.533551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1501423591 Jun 17 08:59:33.533551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 08:59:33.533551 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 08:59:33.535500 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b493dbf75ed64a7dbda3e9c6a6168f8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b493dbf75ed64a7dbda3e9c6a6168f8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b493dbf75ed64a7dbda3e9c6a6168f8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b493dbf75ed64a7dbda3e9c6a6168f8f"}]}] Jun 17 08:59:33.535500 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1501423591 Jun 17 08:59:33.535500 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: b493dbf75ed64a7dbda3e9c6a6168f8f Jun 17 08:59:33.535500 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1501423591 Jun 17 08:59:33.535500 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-AttachVolumeShelveTestJSON-1501423591-project Jun 17 08:59:33.535500 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 08:59:33.535500 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 08:59:33.535500 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: b0eb46b0aeeb46fe8dcdb02f29ae4013 Jun 17 08:59:33.535500 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1501423591-project Jun 17 08:59:33.535500 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: > Jun 17 08:59:33.535500 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Instance 397d996b-b163-4a47-856e-f2aca2ae6976 could not be found. Jun 17 08:59:33.535500 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'id': '397d996b-b163-4a47-856e-f2aca2ae6976'} Jun 17 08:59:33.536376 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:59:33.536376 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:33.536376 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:59:33.536376 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:59:33.536376 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:59:33.536376 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:59:33.536376 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:59:33.536376 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:59:33.536376 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:59:33.536376 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:59:33.536376 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 397d996b-b163-4a47-856e-f2aca2ae6976 could not be found. Jun 17 08:59:33.536376 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:33.536376 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:33.536376 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:33.536376 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:33.536376 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:33.536376 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:33.536376 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:59:33.536376 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:59:33.536376 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:59:33.537793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:59:33.537793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:59:33.537793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:59:33.537793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:59:33.537793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:59:33.537793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:59:33.537793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:59:33.537793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 397d996b-b163-4a47-856e-f2aca2ae6976 could not be found. Jun 17 08:59:33.537793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:33.537793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:33.537793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:33.537793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:33.537793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:33.537793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:33.537793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:59:33.537793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:59:33.537793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 397d996b-b163-4a47-856e-f2aca2ae6976 could not be found. Jun 17 08:59:33.537793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 08:59:33.539131 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-554e9bbf-57b9-438a-b47e-9820e096645c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] Returning 404 to user: Instance 397d996b-b163-4a47-856e-f2aca2ae6976 could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:59:33.539131 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-554e9bbf-57b9-438a-b47e-9820e096645c tempest-AttachVolumeShelveTestJSON-1501423591 tempest-AttachVolumeShelveTestJSON-1501423591-project] 10.222.0.78 "GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976" status: 404 len: 111 microversion: 2.20 time: 0.036286 Jun 17 08:59:33.539131 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 509/1026] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jun 17 08:59:33 2022] GET /compute/v2.1/servers/397d996b-b163-4a47-856e-f2aca2ae6976 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 08:59:33.883556 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-331a219f-ff69-4828-bda7-5c6f84d72fc1 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:33.884063 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-331a219f-ff69-4828-bda7-5c6f84d72fc1 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:33.887035 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-69f1b504-81b5-4050-bce2-fa8ad7762dec req-10d83054-9620-47a7-8dc7-4ce321921b06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e32781c-7056-4c56-a02d-4c94cbc414f8", "tag": "3b983d08-82e5-4031-8c13-d190ca57fc87"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:59:33.892731 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-331a219f-ff69-4828-bda7-5c6f84d72fc1 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:33.893200 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-331a219f-ff69-4828-bda7-5c6f84d72fc1 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:33.894682 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-331a219f-ff69-4828-bda7-5c6f84d72fc1 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:33.895313 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-331a219f-ff69-4828-bda7-5c6f84d72fc1 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:33.898529 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-69f1b504-81b5-4050-bce2-fa8ad7762dec req-10d83054-9620-47a7-8dc7-4ce321921b06 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:33.899209 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-69f1b504-81b5-4050-bce2-fa8ad7762dec req-10d83054-9620-47a7-8dc7-4ce321921b06 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:33.918575 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-69f1b504-81b5-4050-bce2-fa8ad7762dec req-10d83054-9620-47a7-8dc7-4ce321921b06 service nova] Creating event network-changed:3b983d08-82e5-4031-8c13-d190ca57fc87 for instance 8e32781c-7056-4c56-a02d-4c94cbc414f8 on hv-cinder-79760 Jun 17 08:59:33.926841 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-69f1b504-81b5-4050-bce2-fa8ad7762dec req-10d83054-9620-47a7-8dc7-4ce321921b06 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044376 Jun 17 08:59:33.928129 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 510/1027] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:59:33.936525 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-331a219f-ff69-4828-bda7-5c6f84d72fc1 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Going to try to terminate instance {{(pid=129876) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:59:34.316219 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-331a219f-ff69-4828-bda7-5c6f84d72fc1 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 204 len: 0 microversion: 2.1 time: 0.437008 Jun 17 08:59:34.316819 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 518/1028] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 08:59:33 2022] DELETE /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:59:34.328203 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-4402a13c-c287-43e2-9ab1-61dc4407ab0d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:34.329116 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-4402a13c-c287-43e2-9ab1-61dc4407ab0d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:34.337323 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4402a13c-c287-43e2-9ab1-61dc4407ab0d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:34.337861 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4402a13c-c287-43e2-9ab1-61dc4407ab0d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:34.339813 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4402a13c-c287-43e2-9ab1-61dc4407ab0d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:34.340795 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4402a13c-c287-43e2-9ab1-61dc4407ab0d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:34.585944 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-4402a13c-c287-43e2-9ab1-61dc4407ab0d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:34.599637 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-4402a13c-c287-43e2-9ab1-61dc4407ab0d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1569 microversion: 2.1 time: 0.276753 Jun 17 08:59:34.601906 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 511/1029] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:34 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1569 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:59:35.619068 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-60c4f2c3-a0fc-4dfa-8e8e-746ffa3cf10d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:35.619968 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-60c4f2c3-a0fc-4dfa-8e8e-746ffa3cf10d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:35.627550 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-60c4f2c3-a0fc-4dfa-8e8e-746ffa3cf10d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:35.628619 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-60c4f2c3-a0fc-4dfa-8e8e-746ffa3cf10d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:35.629683 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-60c4f2c3-a0fc-4dfa-8e8e-746ffa3cf10d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:35.630175 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-60c4f2c3-a0fc-4dfa-8e8e-746ffa3cf10d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:35.851517 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-60c4f2c3-a0fc-4dfa-8e8e-746ffa3cf10d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:35.860778 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-60c4f2c3-a0fc-4dfa-8e8e-746ffa3cf10d tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1569 microversion: 2.1 time: 0.246225 Jun 17 08:59:35.862176 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 519/1030] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:35 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1569 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:59:36.817509 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-1101cdcd-6581-4b14-9b7e-71982e5c06df req-38f1c3ca-4d19-46ad-8a0f-8daba901588f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e32781c-7056-4c56-a02d-4c94cbc414f8", "name": "network-vif-deleted", "tag": "3b983d08-82e5-4031-8c13-d190ca57fc87"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:59:36.828191 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-1101cdcd-6581-4b14-9b7e-71982e5c06df req-38f1c3ca-4d19-46ad-8a0f-8daba901588f service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:36.828191 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-1101cdcd-6581-4b14-9b7e-71982e5c06df req-38f1c3ca-4d19-46ad-8a0f-8daba901588f service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:36.839927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-1101cdcd-6581-4b14-9b7e-71982e5c06df req-38f1c3ca-4d19-46ad-8a0f-8daba901588f service nova] Creating event network-vif-deleted:3b983d08-82e5-4031-8c13-d190ca57fc87 for instance 8e32781c-7056-4c56-a02d-4c94cbc414f8 on hv-cinder-79760 Jun 17 08:59:36.845869 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-1101cdcd-6581-4b14-9b7e-71982e5c06df req-38f1c3ca-4d19-46ad-8a0f-8daba901588f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032352 Jun 17 08:59:36.846838 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 512/1031] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:59:36.878778 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-caeb580a-47fa-4cd0-8f55-6a873935a0c0 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:36.879428 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-caeb580a-47fa-4cd0-8f55-6a873935a0c0 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:36.887504 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-caeb580a-47fa-4cd0-8f55-6a873935a0c0 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:36.887970 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-caeb580a-47fa-4cd0-8f55-6a873935a0c0 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:36.888761 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-caeb580a-47fa-4cd0-8f55-6a873935a0c0 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:36.889202 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-caeb580a-47fa-4cd0-8f55-6a873935a0c0 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:36.974032 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-caeb580a-47fa-4cd0-8f55-6a873935a0c0 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:36.983184 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-caeb580a-47fa-4cd0-8f55-6a873935a0c0 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1384 microversion: 2.1 time: 0.108552 Jun 17 08:59:36.986629 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 520/1032] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:36 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1384 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:59:38.005261 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-e0da8d17-5834-47f6-8ea4-6e015bf4cfa8 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:38.006104 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-e0da8d17-5834-47f6-8ea4-6e015bf4cfa8 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:38.012745 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e0da8d17-5834-47f6-8ea4-6e015bf4cfa8 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:38.015435 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e0da8d17-5834-47f6-8ea4-6e015bf4cfa8 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:38.015435 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e0da8d17-5834-47f6-8ea4-6e015bf4cfa8 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:38.015435 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e0da8d17-5834-47f6-8ea4-6e015bf4cfa8 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:38.047701 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e0da8d17-5834-47f6-8ea4-6e015bf4cfa8 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:38.048161 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e0da8d17-5834-47f6-8ea4-6e015bf4cfa8 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:38.048620 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-e0da8d17-5834-47f6-8ea4-6e015bf4cfa8 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lazy-loading 'fault' on Instance uuid 8e32781c-7056-4c56-a02d-4c94cbc414f8 {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:59:38.094241 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-e0da8d17-5834-47f6-8ea4-6e015bf4cfa8 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec25ac241c94d4dbebb361c55f10f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e69cf14c3c8482fbf95620efe1bee1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:38.103230 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-e0da8d17-5834-47f6-8ea4-6e015bf4cfa8 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 200 len: 1225 microversion: 2.1 time: 0.102751 Jun 17 08:59:38.112923 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 513/1033] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:37 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:59:39.121871 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-dbac3b8d-f935-4ca2-a317-7384870ad750 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:39.123202 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-dbac3b8d-f935-4ca2-a317-7384870ad750 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] [instance: 8e32781c-7056-4c56-a02d-4c94cbc414f8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:39.130151 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dbac3b8d-f935-4ca2-a317-7384870ad750 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:39.130666 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dbac3b8d-f935-4ca2-a317-7384870ad750 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:39.131499 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dbac3b8d-f935-4ca2-a317-7384870ad750 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:39.132923 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dbac3b8d-f935-4ca2-a317-7384870ad750 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:39.146059 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-dbac3b8d-f935-4ca2-a317-7384870ad750 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] HTTP exception thrown: Instance 8e32781c-7056-4c56-a02d-4c94cbc414f8 could not be found. Jun 17 08:59:39.147748 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-dbac3b8d-f935-4ca2-a317-7384870ad750 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Request method failure captured: Jun 17 08:59:39.147748 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 HTTP/1.1 Jun 17 08:59:39.147748 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 08:59:39.147748 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 08:59:39.147748 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 08:59:39.147748 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 08:59:39.147748 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 08:59:39.147748 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 08:59:39.147748 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 08:59:39.147748 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 08:59:39.147748 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirEECsliGvvaL6LF-exbHmmocYEYp8z04u2S0LRO68fOxIuz1n58MBh5VOGnxsrOJfbuWxZYN46ymD32G1kt3vXFtL-tYYXbBDWFTmN7cm4wVS0yj6Kz611cGfr0msTzd86neFY2W9Gr8zMRHmLAZyS449RVibKX9tQKNSZ9t7hR-mPE Jun 17 08:59:39.147748 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 08:59:39.147748 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 08:59:39.147748 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 08:59:39.147748 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 08:59:39.147748 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 08:59:39.147748 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 08:59:39.147748 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: 7e69cf14c3c8482fbf95620efe1bee1d Jun 17 08:59:39.147748 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-TestShelveInstance-1321630281 Jun 17 08:59:39.147748 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 08:59:39.147748 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 08:59:39.149336 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7e69cf14c3c8482fbf95620efe1bee1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7e69cf14c3c8482fbf95620efe1bee1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7e69cf14c3c8482fbf95620efe1bee1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7e69cf14c3c8482fbf95620efe1bee1d"}]}] Jun 17 08:59:39.149336 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-TestShelveInstance-1321630281 Jun 17 08:59:39.149336 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: 7e69cf14c3c8482fbf95620efe1bee1d Jun 17 08:59:39.149336 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-TestShelveInstance-1321630281 Jun 17 08:59:39.149336 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-TestShelveInstance-1321630281-project Jun 17 08:59:39.149336 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 08:59:39.149336 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 08:59:39.149336 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: fec25ac241c94d4dbebb361c55f10f75 Jun 17 08:59:39.149336 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-TestShelveInstance-1321630281-project Jun 17 08:59:39.149336 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 08:59:39.149336 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Instance 8e32781c-7056-4c56-a02d-4c94cbc414f8 could not be found. Jun 17 08:59:39.149336 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'id': '8e32781c-7056-4c56-a02d-4c94cbc414f8'} Jun 17 08:59:39.150252 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:59:39.150252 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:39.150252 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:59:39.150252 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:59:39.150252 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:59:39.150252 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:59:39.150252 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:59:39.150252 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:59:39.150252 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:59:39.150252 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:59:39.150252 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e32781c-7056-4c56-a02d-4c94cbc414f8 could not be found. Jun 17 08:59:39.150252 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:39.150252 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:39.150252 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:39.150252 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:39.150252 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:39.150252 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:39.150252 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:59:39.150252 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:59:39.150252 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:59:39.155716 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:59:39.155716 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:59:39.155716 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:59:39.155716 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:59:39.155716 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:59:39.155716 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:59:39.155716 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:59:39.155716 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e32781c-7056-4c56-a02d-4c94cbc414f8 could not be found. Jun 17 08:59:39.155716 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:39.155716 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:39.155716 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:39.155716 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:39.155716 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:39.155716 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:39.155716 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:59:39.155716 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:59:39.155716 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e32781c-7056-4c56-a02d-4c94cbc414f8 could not be found. Jun 17 08:59:39.155716 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 08:59:39.157543 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-dbac3b8d-f935-4ca2-a317-7384870ad750 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Returning 404 to user: Instance 8e32781c-7056-4c56-a02d-4c94cbc414f8 could not be found. {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:59:39.157543 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-dbac3b8d-f935-4ca2-a317-7384870ad750 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8" status: 404 len: 111 microversion: 2.1 time: 0.032336 Jun 17 08:59:39.157543 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 521/1034] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:39 2022] GET /compute/v2.1/servers/8e32781c-7056-4c56-a02d-4c94cbc414f8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:59:39.454161 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a6de968d-6f47-4cc7-a576-2d0377ddae54 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] Calling method '.version_select at 0x7fbc403de700>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:39.597442 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-a6de968d-6f47-4cc7-a576-2d0377ddae54 tempest-TestShelveInstance-1321630281 tempest-TestShelveInstance-1321630281-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1164176646" status: 202 len: 0 microversion: 2.1 time: 0.147050 Jun 17 08:59:39.597949 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 514/1035] 10.222.0.78 () {58 vars in 1253 bytes} [Fri Jun 17 08:59:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1164176646 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:59:47.704333 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-5574ee56-b27a-4392-93a5-c21245d27837 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Action: 'create', calling method: .version_select at 0x7fbc33b6ef70>, body: {"keypair": {"name": "tempest-keypair-1094708853", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDddox2p+u0LGLuHeWhGpha0HyDHD2RgPuZ0TA0TZ0EunBVOLvJL2SuLYi9HIL2004AzNHOC1Zpfh/kR7CXMstd3jeUsdHb7SYdv8sdWabGsshA9wc8MDFdjUPfbSwgRIg=="}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:59:47.735722 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-5574ee56-b27a-4392-93a5-c21245d27837 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Getting quotas for project f0964a125c554efe858f7695016de8db. Resources: {'key_pairs'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:59:47.745273 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-5574ee56-b27a-4392-93a5-c21245d27837 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Getting quotas for user 449850e1f8d144eb8b330a764882a099 and project f0964a125c554efe858f7695016de8db. Resources: {'key_pairs'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:59:47.854986 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-5574ee56-b27a-4392-93a5-c21245d27837 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.445521 Jun 17 08:59:47.855939 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 522/1036] 10.222.0.78 () {60 vars in 1158 bytes} [Fri Jun 17 08:59:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:59:51.363743 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d17b1dc9-7efe-4ff8-a3be-c7c8d59e3459 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-369484148", "imageRef": "978084c7-ed2c-4e42-ac8b-f5d19c4001fe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7268d72-a199-4405-a1f3-cc49733ddcf9"}], "security_groups": [{"name": "tempest-securitygroup--1932464618"}], "key_name": "tempest-keypair-1094708853", "user_data": "}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:59:51.379071 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=48 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:51.379866 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=2 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:51.507985 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.network.neutron [None req-d17b1dc9-7efe-4ff8-a3be-c7c8d59e3459 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] validate_networks() for [('f7268d72-a199-4405-a1f3-cc49733ddcf9', None, None, None, None, None)] {{(pid=129875) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:59:51.945209 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-d17b1dc9-7efe-4ff8-a3be-c7c8d59e3459 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Flavor limits 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:59:51.945637 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-d17b1dc9-7efe-4ff8-a3be-c7c8d59e3459 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Image limits 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:59:51.946130 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-d17b1dc9-7efe-4ff8-a3be-c7c8d59e3459 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Flavor pref 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:59:51.946530 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-d17b1dc9-7efe-4ff8-a3be-c7c8d59e3459 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Image pref 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:59:51.946946 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-d17b1dc9-7efe-4ff8-a3be-c7c8d59e3459 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:59:51.955856 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d17b1dc9-7efe-4ff8-a3be-c7c8d59e3459 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:51.956300 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d17b1dc9-7efe-4ff8-a3be-c7c8d59e3459 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:51.957299 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d17b1dc9-7efe-4ff8-a3be-c7c8d59e3459 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:51.957736 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d17b1dc9-7efe-4ff8-a3be-c7c8d59e3459 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:51.975220 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-d17b1dc9-7efe-4ff8-a3be-c7c8d59e3459 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Getting quotas for project f0964a125c554efe858f7695016de8db. Resources: {'ram', 'cores', 'instances'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:59:51.979455 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-d17b1dc9-7efe-4ff8-a3be-c7c8d59e3459 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Getting quotas for user 449850e1f8d144eb8b330a764882a099 and project f0964a125c554efe858f7695016de8db. Resources: {'ram', 'cores', 'instances'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:59:51.991769 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-d17b1dc9-7efe-4ff8-a3be-c7c8d59e3459 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Going to run 1 instances... {{(pid=129875) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:59:51.994119 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-d17b1dc9-7efe-4ff8-a3be-c7c8d59e3459 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='978084c7-ed2c-4e42-ac8b-f5d19c4001fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:59:52.198642 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-d17b1dc9-7efe-4ff8-a3be-c7c8d59e3459 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.839942 Jun 17 08:59:52.210572 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:52.214560 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-b73bb5f1-1f5d-4fbb-8392-b2ab3167ea8c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:52.215194 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-b73bb5f1-1f5d-4fbb-8392-b2ab3167ea8c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:52.218137 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 515/1037] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jun 17 08:59:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:59:52.272742 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-b73bb5f1-1f5d-4fbb-8392-b2ab3167ea8c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:52.280750 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-b73bb5f1-1f5d-4fbb-8392-b2ab3167ea8c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1237 microversion: 2.1 time: 0.070910 Jun 17 08:59:52.281728 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 523/1038] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:52 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:59:53.298249 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-2bfa9113-dfe0-4565-8f5e-aa0991f0c994 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:53.298801 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-2bfa9113-dfe0-4565-8f5e-aa0991f0c994 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:53.358460 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2bfa9113-dfe0-4565-8f5e-aa0991f0c994 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:53.365488 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-2bfa9113-dfe0-4565-8f5e-aa0991f0c994 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1237 microversion: 2.1 time: 0.072102 Jun 17 08:59:53.366074 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 516/1039] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:53 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:59:54.382204 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-15ba906b-6819-4311-a4b2-67526ac959d0 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:54.382739 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-15ba906b-6819-4311-a4b2-67526ac959d0 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:54.385416 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:54.390759 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-15ba906b-6819-4311-a4b2-67526ac959d0 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:54.391216 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-15ba906b-6819-4311-a4b2-67526ac959d0 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:54.392019 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-15ba906b-6819-4311-a4b2-67526ac959d0 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:54.392459 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-15ba906b-6819-4311-a4b2-67526ac959d0 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:54.454009 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-15ba906b-6819-4311-a4b2-67526ac959d0 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:54.461963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-15ba906b-6819-4311-a4b2-67526ac959d0 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1241 microversion: 2.1 time: 0.083637 Jun 17 08:59:54.462529 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 524/1040] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:54 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:59:55.479439 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-07386521-f806-4385-a846-09e499152b1e tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:55.480053 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-07386521-f806-4385-a846-09e499152b1e tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:55.486793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-07386521-f806-4385-a846-09e499152b1e tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:55.487325 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-07386521-f806-4385-a846-09e499152b1e tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:55.488133 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-07386521-f806-4385-a846-09e499152b1e tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:55.488579 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-07386521-f806-4385-a846-09e499152b1e tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:55.554709 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-07386521-f806-4385-a846-09e499152b1e tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:55.562851 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-07386521-f806-4385-a846-09e499152b1e tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1289 microversion: 2.1 time: 0.087447 Jun 17 08:59:55.563437 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 517/1041] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:55 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:59:56.581615 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-6e9fc4eb-d808-49e0-b0ea-6a54bc822ee7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:56.583013 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-6e9fc4eb-d808-49e0-b0ea-6a54bc822ee7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:56.591259 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6e9fc4eb-d808-49e0-b0ea-6a54bc822ee7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:56.592122 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6e9fc4eb-d808-49e0-b0ea-6a54bc822ee7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:56.594256 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6e9fc4eb-d808-49e0-b0ea-6a54bc822ee7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:56.594946 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6e9fc4eb-d808-49e0-b0ea-6a54bc822ee7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:56.766650 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-6e9fc4eb-d808-49e0-b0ea-6a54bc822ee7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:56.774487 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-6e9fc4eb-d808-49e0-b0ea-6a54bc822ee7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1363 microversion: 2.1 time: 0.198293 Jun 17 08:59:56.775277 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 525/1042] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:56 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:59:57.665318 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-0ca57e85-9cc7-49d2-9eb3-3e358131726b req-8d26bc20-d6ac-4919-b457-e84a5db5afa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d29e3483-56d1-40fb-a15f-5a57da6e5475", "tag": "7443cff9-145e-466b-bab6-4dd50a0da0ac"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:59:57.676527 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-0ca57e85-9cc7-49d2-9eb3-3e358131726b req-8d26bc20-d6ac-4919-b457-e84a5db5afa0 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:57.677085 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-0ca57e85-9cc7-49d2-9eb3-3e358131726b req-8d26bc20-d6ac-4919-b457-e84a5db5afa0 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:57.690888 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-0ca57e85-9cc7-49d2-9eb3-3e358131726b req-8d26bc20-d6ac-4919-b457-e84a5db5afa0 service nova] Creating event network-changed:7443cff9-145e-466b-bab6-4dd50a0da0ac for instance d29e3483-56d1-40fb-a15f-5a57da6e5475 on hv-cinder-79760 Jun 17 08:59:57.703259 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-0ca57e85-9cc7-49d2-9eb3-3e358131726b req-8d26bc20-d6ac-4919-b457-e84a5db5afa0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037781 Jun 17 08:59:57.703259 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 518/1043] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 08:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:59:57.803857 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e8f6ac8a-9a75-4f84-b63f-287fdea026ce tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:57.804649 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-e8f6ac8a-9a75-4f84-b63f-287fdea026ce tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:57.813378 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e8f6ac8a-9a75-4f84-b63f-287fdea026ce tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:57.813958 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e8f6ac8a-9a75-4f84-b63f-287fdea026ce tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:57.814865 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e8f6ac8a-9a75-4f84-b63f-287fdea026ce tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:57.815434 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e8f6ac8a-9a75-4f84-b63f-287fdea026ce tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:57.955241 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e8f6ac8a-9a75-4f84-b63f-287fdea026ce tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:57.963035 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-e8f6ac8a-9a75-4f84-b63f-287fdea026ce tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1363 microversion: 2.1 time: 0.163038 Jun 17 08:59:57.964018 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 526/1044] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:57 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:59:58.981235 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-24f558cd-3570-4de1-b57a-4e9ef90f475f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:58.981839 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-24f558cd-3570-4de1-b57a-4e9ef90f475f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:58.988405 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-24f558cd-3570-4de1-b57a-4e9ef90f475f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:58.988852 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-24f558cd-3570-4de1-b57a-4e9ef90f475f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:58.989604 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-24f558cd-3570-4de1-b57a-4e9ef90f475f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:58.990045 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-24f558cd-3570-4de1-b57a-4e9ef90f475f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:59.132953 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-24f558cd-3570-4de1-b57a-4e9ef90f475f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:59.141426 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-24f558cd-3570-4de1-b57a-4e9ef90f475f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1363 microversion: 2.1 time: 0.164847 Jun 17 08:59:59.142030 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 519/1045] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:58 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:00:00.158112 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-6ca3f333-fc94-48cc-a102-57eddb4bca5f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:00:00.158638 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-6ca3f333-fc94-48cc-a102-57eddb4bca5f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:00.165396 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6ca3f333-fc94-48cc-a102-57eddb4bca5f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:00.165857 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6ca3f333-fc94-48cc-a102-57eddb4bca5f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:00.166635 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6ca3f333-fc94-48cc-a102-57eddb4bca5f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:00.167078 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6ca3f333-fc94-48cc-a102-57eddb4bca5f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:00.299998 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-6ca3f333-fc94-48cc-a102-57eddb4bca5f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:00:00.307600 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-6ca3f333-fc94-48cc-a102-57eddb4bca5f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1363 microversion: 2.1 time: 0.153393 Jun 17 09:00:00.308150 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 527/1046] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:00:00 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:00:01.325087 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-97c89f12-2785-4d0d-adfc-d135101eb8b5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:00:01.325700 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-97c89f12-2785-4d0d-adfc-d135101eb8b5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:01.333817 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-97c89f12-2785-4d0d-adfc-d135101eb8b5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:01.334271 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-97c89f12-2785-4d0d-adfc-d135101eb8b5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:01.335042 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-97c89f12-2785-4d0d-adfc-d135101eb8b5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:01.339683 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-97c89f12-2785-4d0d-adfc-d135101eb8b5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:01.491538 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-97c89f12-2785-4d0d-adfc-d135101eb8b5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:00:01.500439 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-97c89f12-2785-4d0d-adfc-d135101eb8b5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1363 microversion: 2.1 time: 0.179098 Jun 17 09:00:01.501068 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 520/1047] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:00:01 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:00:02.517530 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-1008a94d-495f-4acd-93e3-50a2658301e2 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:00:02.518123 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-1008a94d-495f-4acd-93e3-50a2658301e2 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:02.520433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=6 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:02.525323 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1008a94d-495f-4acd-93e3-50a2658301e2 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:02.525774 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1008a94d-495f-4acd-93e3-50a2658301e2 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:02.526531 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1008a94d-495f-4acd-93e3-50a2658301e2 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:02.527001 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1008a94d-495f-4acd-93e3-50a2658301e2 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:02.657426 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-1008a94d-495f-4acd-93e3-50a2658301e2 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:00:02.664998 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-1008a94d-495f-4acd-93e3-50a2658301e2 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1363 microversion: 2.1 time: 0.151994 Jun 17 09:00:02.665566 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 528/1048] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:00:02 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 09:00:03.565637 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-ffe86dc4-1b4f-4bc2-880b-a8f63bae3681 req-5fd93f18-8961-415a-897e-203e93d5c7be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29e3483-56d1-40fb-a15f-5a57da6e5475", "name": "network-vif-plugged", "status": "completed", "tag": "7443cff9-145e-466b-bab6-4dd50a0da0ac"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:00:03.569578 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=2 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:03.570889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=8 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:03.577884 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-ffe86dc4-1b4f-4bc2-880b-a8f63bae3681 req-5fd93f18-8961-415a-897e-203e93d5c7be service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:03.578499 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-ffe86dc4-1b4f-4bc2-880b-a8f63bae3681 req-5fd93f18-8961-415a-897e-203e93d5c7be service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:03.591296 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-ffe86dc4-1b4f-4bc2-880b-a8f63bae3681 req-5fd93f18-8961-415a-897e-203e93d5c7be service nova] Creating event network-vif-plugged:7443cff9-145e-466b-bab6-4dd50a0da0ac for instance d29e3483-56d1-40fb-a15f-5a57da6e5475 on hv-cinder-79760 Jun 17 09:00:03.597241 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-ffe86dc4-1b4f-4bc2-880b-a8f63bae3681 req-5fd93f18-8961-415a-897e-203e93d5c7be service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036320 Jun 17 09:00:03.597915 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 521/1049] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 09:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:00:03.682857 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-02c59304-d515-44e9-b363-e10048d2a680 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:00:03.684157 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-02c59304-d515-44e9-b363-e10048d2a680 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:03.691605 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-02c59304-d515-44e9-b363-e10048d2a680 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:03.692063 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-02c59304-d515-44e9-b363-e10048d2a680 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:03.692848 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-02c59304-d515-44e9-b363-e10048d2a680 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:03.693290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-02c59304-d515-44e9-b363-e10048d2a680 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:03.836135 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-02c59304-d515-44e9-b363-e10048d2a680 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:00:03.843704 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-02c59304-d515-44e9-b363-e10048d2a680 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1363 microversion: 2.1 time: 0.165417 Jun 17 09:00:03.844271 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 529/1050] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:00:03 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:00:04.861953 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-7133eb44-367a-4df6-ad2b-6d7abbf863bc tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:00:04.862670 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-7133eb44-367a-4df6-ad2b-6d7abbf863bc tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:04.869823 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7133eb44-367a-4df6-ad2b-6d7abbf863bc tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:04.870347 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7133eb44-367a-4df6-ad2b-6d7abbf863bc tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:04.871115 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7133eb44-367a-4df6-ad2b-6d7abbf863bc tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:04.871589 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7133eb44-367a-4df6-ad2b-6d7abbf863bc tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:05.002522 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-7133eb44-367a-4df6-ad2b-6d7abbf863bc tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:00:05.009940 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-7133eb44-367a-4df6-ad2b-6d7abbf863bc tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1363 microversion: 2.1 time: 0.153428 Jun 17 09:00:05.010501 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 522/1051] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:00:04 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:00:06.027254 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-b08d89e9-863c-4a04-8bb6-48fcd09068d2 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:00:06.027903 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-b08d89e9-863c-4a04-8bb6-48fcd09068d2 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:06.037245 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b08d89e9-863c-4a04-8bb6-48fcd09068d2 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:06.037705 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b08d89e9-863c-4a04-8bb6-48fcd09068d2 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:06.038494 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b08d89e9-863c-4a04-8bb6-48fcd09068d2 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:06.038937 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b08d89e9-863c-4a04-8bb6-48fcd09068d2 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:06.190674 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-b08d89e9-863c-4a04-8bb6-48fcd09068d2 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:00:06.198689 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-b08d89e9-863c-4a04-8bb6-48fcd09068d2 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1363 microversion: 2.1 time: 0.175351 Jun 17 09:00:06.199255 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 530/1052] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:00:06 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:00:07.216167 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-5a0eb903-eb15-4bca-b74d-c38a7410b468 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:00:07.216775 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-5a0eb903-eb15-4bca-b74d-c38a7410b468 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:07.223965 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5a0eb903-eb15-4bca-b74d-c38a7410b468 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:07.224413 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5a0eb903-eb15-4bca-b74d-c38a7410b468 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:07.225172 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5a0eb903-eb15-4bca-b74d-c38a7410b468 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:07.225609 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5a0eb903-eb15-4bca-b74d-c38a7410b468 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:07.361999 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-5a0eb903-eb15-4bca-b74d-c38a7410b468 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:00:07.370835 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-5a0eb903-eb15-4bca-b74d-c38a7410b468 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1363 microversion: 2.1 time: 0.158459 Jun 17 09:00:07.371435 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 523/1053] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:00:07 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:00:08.387993 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-fcda63f1-a0c3-4b24-aa52-351b55a22c67 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:00:08.389307 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-fcda63f1-a0c3-4b24-aa52-351b55a22c67 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:08.396109 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fcda63f1-a0c3-4b24-aa52-351b55a22c67 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:08.396627 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fcda63f1-a0c3-4b24-aa52-351b55a22c67 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:08.397401 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fcda63f1-a0c3-4b24-aa52-351b55a22c67 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:08.397834 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fcda63f1-a0c3-4b24-aa52-351b55a22c67 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:08.536832 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-fcda63f1-a0c3-4b24-aa52-351b55a22c67 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:00:08.544540 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-fcda63f1-a0c3-4b24-aa52-351b55a22c67 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1548 microversion: 2.1 time: 0.160347 Jun 17 09:00:08.545387 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 531/1054] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:00:08 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:00:08.561503 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-af92e873-3e61-46b2-8d51-a2aa1fba6257 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:00:08.562066 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-af92e873-3e61-46b2-8d51-a2aa1fba6257 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:08.568727 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-af92e873-3e61-46b2-8d51-a2aa1fba6257 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:08.569115 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-af92e873-3e61-46b2-8d51-a2aa1fba6257 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:08.569887 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-af92e873-3e61-46b2-8d51-a2aa1fba6257 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:08.570361 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-af92e873-3e61-46b2-8d51-a2aa1fba6257 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:08.655021 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-af92e873-3e61-46b2-8d51-a2aa1fba6257 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097503 Jun 17 09:00:08.655629 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 524/1055] 10.222.0.78 () {58 vars in 1274 bytes} [Fri Jun 17 09:00:08 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:00:09.675607 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-59c115c4-1fe4-4173-a69e-5d69a2e623ce req-e4d3aac1-aaf9-4de8-a1c6-c7955b341cff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d29e3483-56d1-40fb-a15f-5a57da6e5475", "tag": "7443cff9-145e-466b-bab6-4dd50a0da0ac"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:00:09.684196 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-59c115c4-1fe4-4173-a69e-5d69a2e623ce req-e4d3aac1-aaf9-4de8-a1c6-c7955b341cff service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:09.684745 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-59c115c4-1fe4-4173-a69e-5d69a2e623ce req-e4d3aac1-aaf9-4de8-a1c6-c7955b341cff service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:09.696675 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-59c115c4-1fe4-4173-a69e-5d69a2e623ce req-e4d3aac1-aaf9-4de8-a1c6-c7955b341cff service nova] Creating event network-changed:7443cff9-145e-466b-bab6-4dd50a0da0ac for instance d29e3483-56d1-40fb-a15f-5a57da6e5475 on hv-cinder-79760 Jun 17 09:00:09.702672 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-59c115c4-1fe4-4173-a69e-5d69a2e623ce req-e4d3aac1-aaf9-4de8-a1c6-c7955b341cff service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031152 Jun 17 09:00:09.703681 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 532/1056] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 09:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:00:44.671750 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:44.672837 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=40 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:44.676810 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-b43e5e2e-6806-471e-bf67-bddf00951bf4 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:00:44.677326 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-b43e5e2e-6806-471e-bf67-bddf00951bf4 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:44.684263 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b43e5e2e-6806-471e-bf67-bddf00951bf4 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:44.684719 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b43e5e2e-6806-471e-bf67-bddf00951bf4 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:44.685501 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b43e5e2e-6806-471e-bf67-bddf00951bf4 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:44.686110 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-b43e5e2e-6806-471e-bf67-bddf00951bf4 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:44.710130 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-b43e5e2e-6806-471e-bf67-bddf00951bf4 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475/ips" status: 200 len: 145 microversion: 2.1 time: 0.040868 Jun 17 09:00:44.710706 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 525/1057] 10.222.0.78 () {58 vars in 1247 bytes} [Fri Jun 17 09:00:44 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:00:47.400228 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_api:SELECT=17 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:47.400976 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=50 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:47.405941 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-76563ec1-7630-4a32-bc9b-4fcc9d7ab773 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5451e03-c0dc-4ebf-8685-1b412f12191f"}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:00:47.407775 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-76563ec1-7630-4a32-bc9b-4fcc9d7ab773 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:47.414712 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-76563ec1-7630-4a32-bc9b-4fcc9d7ab773 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:47.415173 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-76563ec1-7630-4a32-bc9b-4fcc9d7ab773 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:47.415986 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-76563ec1-7630-4a32-bc9b-4fcc9d7ab773 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:47.416431 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-76563ec1-7630-4a32-bc9b-4fcc9d7ab773 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:48.159482 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-76563ec1-7630-4a32-bc9b-4fcc9d7ab773 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "POST /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.760716 Jun 17 09:00:48.160101 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 533/1058] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jun 17 09:00:47 2022] POST /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475/os-volume_attachments => generated 194 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:00:48.840135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-90d5bf43-fcbf-4e5e-a371-d97440907688 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:00:48.840731 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-90d5bf43-fcbf-4e5e-a371-d97440907688 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:48.848920 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-90d5bf43-fcbf-4e5e-a371-d97440907688 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:48.849368 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-90d5bf43-fcbf-4e5e-a371-d97440907688 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:48.850129 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-90d5bf43-fcbf-4e5e-a371-d97440907688 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:48.850562 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-90d5bf43-fcbf-4e5e-a371-d97440907688 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:48.877214 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-90d5bf43-fcbf-4e5e-a371-d97440907688 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Going to try to terminate instance {{(pid=129875) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 09:00:49.206847 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-90d5bf43-fcbf-4e5e-a371-d97440907688 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 204 len: 0 microversion: 2.1 time: 0.370692 Jun 17 09:00:49.207334 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 526/1059] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 09:00:48 2022] DELETE /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 09:00:49.216684 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-534561cf-e918-4f8c-bf05-3c452cae8afd tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:00:49.217385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-534561cf-e918-4f8c-bf05-3c452cae8afd tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:49.224449 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-534561cf-e918-4f8c-bf05-3c452cae8afd tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:49.224934 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-534561cf-e918-4f8c-bf05-3c452cae8afd tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:49.225748 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-534561cf-e918-4f8c-bf05-3c452cae8afd tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:49.226186 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-534561cf-e918-4f8c-bf05-3c452cae8afd tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:49.367727 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-534561cf-e918-4f8c-bf05-3c452cae8afd tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:00:49.375817 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-534561cf-e918-4f8c-bf05-3c452cae8afd tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1573 microversion: 2.1 time: 0.163454 Jun 17 09:00:49.376477 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 534/1060] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:00:49 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:00:50.394461 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-be6daf6a-f21f-4cfd-b518-03cd201fe3b3 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:00:50.395071 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-be6daf6a-f21f-4cfd-b518-03cd201fe3b3 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:50.401717 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-be6daf6a-f21f-4cfd-b518-03cd201fe3b3 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:50.407436 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-be6daf6a-f21f-4cfd-b518-03cd201fe3b3 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:50.407436 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-be6daf6a-f21f-4cfd-b518-03cd201fe3b3 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:50.407436 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-be6daf6a-f21f-4cfd-b518-03cd201fe3b3 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:50.540704 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-be6daf6a-f21f-4cfd-b518-03cd201fe3b3 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:00:50.548450 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-be6daf6a-f21f-4cfd-b518-03cd201fe3b3 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1573 microversion: 2.1 time: 0.158929 Jun 17 09:00:50.549032 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 527/1061] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:00:50 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:00:51.566493 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-d94e4f4f-738c-4c72-898f-511825937050 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:00:51.568050 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-d94e4f4f-738c-4c72-898f-511825937050 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:51.575718 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d94e4f4f-738c-4c72-898f-511825937050 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:51.576179 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d94e4f4f-738c-4c72-898f-511825937050 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:51.576969 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d94e4f4f-738c-4c72-898f-511825937050 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:51.577445 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d94e4f4f-738c-4c72-898f-511825937050 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:51.613407 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-f86b0d31-e9b9-40aa-ae37-3a8d266e9014 req-a4c87cfa-a25f-49ef-a1ba-564c0c2291bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba9b8cb-042a-41e7-a0bf-2f511d8a685a", "name": "network-vif-deleted", "tag": "1e938f08-b678-482d-a29c-cf7d85d201ba"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:00:51.626356 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-f86b0d31-e9b9-40aa-ae37-3a8d266e9014 req-a4c87cfa-a25f-49ef-a1ba-564c0c2291bf service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:51.631601 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-f86b0d31-e9b9-40aa-ae37-3a8d266e9014 req-a4c87cfa-a25f-49ef-a1ba-564c0c2291bf service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:51.639163 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-f86b0d31-e9b9-40aa-ae37-3a8d266e9014 req-a4c87cfa-a25f-49ef-a1ba-564c0c2291bf service nova] Creating event network-vif-deleted:1e938f08-b678-482d-a29c-cf7d85d201ba for instance 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a on hv-cinder-79760 Jun 17 09:00:51.647268 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-f86b0d31-e9b9-40aa-ae37-3a8d266e9014 req-a4c87cfa-a25f-49ef-a1ba-564c0c2291bf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038008 Jun 17 09:00:51.648826 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 528/1062] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 09:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:00:51.663095 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-d94e4f4f-738c-4c72-898f-511825937050 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:00:51.672648 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-d94e4f4f-738c-4c72-898f-511825937050 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1506 microversion: 2.1 time: 0.108965 Jun 17 09:00:51.672648 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 535/1063] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:00:51 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1506 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:00:52.693230 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-7eac7e9d-1124-4f06-a502-061e6aea7355 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:00:52.693230 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-7eac7e9d-1124-4f06-a502-061e6aea7355 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:52.698080 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7eac7e9d-1124-4f06-a502-061e6aea7355 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:52.698532 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7eac7e9d-1124-4f06-a502-061e6aea7355 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:52.699311 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7eac7e9d-1124-4f06-a502-061e6aea7355 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:52.699779 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7eac7e9d-1124-4f06-a502-061e6aea7355 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:52.733172 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7eac7e9d-1124-4f06-a502-061e6aea7355 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:52.733633 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7eac7e9d-1124-4f06-a502-061e6aea7355 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:52.734194 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-7eac7e9d-1124-4f06-a502-061e6aea7355 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lazy-loading 'fault' on Instance uuid 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 09:00:52.777904 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-7eac7e9d-1124-4f06-a502-061e6aea7355 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:00:52.787552 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-7eac7e9d-1124-4f06-a502-061e6aea7355 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 200 len: 1228 microversion: 2.1 time: 0.101397 Jun 17 09:00:52.789045 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 529/1064] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:00:52 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 1228 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:00:53.807138 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e94f20e7-8b1f-41c3-92f7-73e197b93b44 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:00:53.807793 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-e94f20e7-8b1f-41c3-92f7-73e197b93b44 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:53.814297 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e94f20e7-8b1f-41c3-92f7-73e197b93b44 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:53.814745 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e94f20e7-8b1f-41c3-92f7-73e197b93b44 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:53.815569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e94f20e7-8b1f-41c3-92f7-73e197b93b44 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:53.816001 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e94f20e7-8b1f-41c3-92f7-73e197b93b44 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:53.829348 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-e94f20e7-8b1f-41c3-92f7-73e197b93b44 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] HTTP exception thrown: Instance 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a could not be found. Jun 17 09:00:53.831029 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e94f20e7-8b1f-41c3-92f7-73e197b93b44 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Request method failure captured: Jun 17 09:00:53.831029 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a HTTP/1.1 Jun 17 09:00:53.831029 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 09:00:53.831029 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 09:00:53.831029 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 09:00:53.831029 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 09:00:53.831029 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 09:00:53.831029 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 09:00:53.831029 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 09:00:53.831029 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 09:00:53.831029 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirEIKeO2XlpueOmt6XV4Mtz0ie6WcoHM2o7AWarKz3Cxip9kkDwG5miXS13Hxb8JSviIVkZVKalJLXJBAXW93Ef4LYMhV5qo_ipE3U6Zo8_m-1JB3KGuklzg9e_KHPiOfgo1bWks8eSFC2tbJeBfn8snXM4zzZRr-odFoUOIqxw-3gwk Jun 17 09:00:53.831029 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 09:00:53.831029 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 09:00:53.831029 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 09:00:53.831029 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 09:00:53.831029 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 09:00:53.831029 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 09:00:53.831029 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: 4c3ecf1efb8748a0af09e501e2b9d81b Jun 17 09:00:53.831029 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-TestVolumeBootPattern-2115809400 Jun 17 09:00:53.831029 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 09:00:53.831029 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 09:00:53.832855 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4c3ecf1efb8748a0af09e501e2b9d81b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c3ecf1efb8748a0af09e501e2b9d81b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4c3ecf1efb8748a0af09e501e2b9d81b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c3ecf1efb8748a0af09e501e2b9d81b"}]}] Jun 17 09:00:53.832855 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-TestVolumeBootPattern-2115809400 Jun 17 09:00:53.832855 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: 4c3ecf1efb8748a0af09e501e2b9d81b Jun 17 09:00:53.832855 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-TestVolumeBootPattern-2115809400 Jun 17 09:00:53.832855 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-TestVolumeBootPattern-2115809400-project Jun 17 09:00:53.832855 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 09:00:53.832855 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 09:00:53.832855 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: 61c06d41d371486c9856a17c5b2aee20 Jun 17 09:00:53.832855 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-TestVolumeBootPattern-2115809400-project Jun 17 09:00:53.832855 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 09:00:53.832855 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Instance 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a could not be found. Jun 17 09:00:53.832855 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'id': '7ba9b8cb-042a-41e7-a0bf-2f511d8a685a'} Jun 17 09:00:53.833917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 09:00:53.833917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:00:53.833917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 09:00:53.833917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 09:00:53.833917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 09:00:53.833917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 09:00:53.833917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 09:00:53.833917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 09:00:53.833917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 09:00:53.833917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 09:00:53.833917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a could not be found. Jun 17 09:00:53.833917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:00:53.833917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:00:53.833917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:00:53.833917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:00:53.833917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:00:53.833917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:00:53.833917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 09:00:53.833917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 09:00:53.833917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 09:00:53.835253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 09:00:53.835253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 09:00:53.835253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 09:00:53.835253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 09:00:53.835253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 09:00:53.835253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 09:00:53.835253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 09:00:53.835253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a could not be found. Jun 17 09:00:53.835253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:00:53.835253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:00:53.835253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:00:53.835253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:00:53.835253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:00:53.835253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:00:53.835253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 09:00:53.835253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 09:00:53.835253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a could not be found. Jun 17 09:00:53.835253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:00:53.836494 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e94f20e7-8b1f-41c3-92f7-73e197b93b44 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Returning 404 to user: Instance 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a could not be found. {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 09:00:53.836494 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-e94f20e7-8b1f-41c3-92f7-73e197b93b44 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 404 len: 111 microversion: 2.1 time: 0.029537 Jun 17 09:00:53.836494 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 536/1065] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:00:53 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 09:00:53.929002 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-163f22cc-d89f-42a5-9850-4879471d652b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1455413837", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-899283893", "security_groups": [{"name": "tempest-secgroup-smoke-926804049"}], "block_device_mapping_v2": [{"uuid": "62268ed6-46dd-41fc-9c9d-aa005b7bc9c2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "131209d2-1a19-4f69-ac13-17a3bc0e6ba1"}]}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:00:54.045681 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.network.neutron [None req-163f22cc-d89f-42a5-9850-4879471d652b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] validate_networks() for [('131209d2-1a19-4f69-ac13-17a3bc0e6ba1', None, None, None, None, None)] {{(pid=129875) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 09:00:54.435842 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-163f22cc-d89f-42a5-9850-4879471d652b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Flavor limits 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 09:00:54.435842 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-163f22cc-d89f-42a5-9850-4879471d652b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Image limits 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 09:00:54.435842 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-163f22cc-d89f-42a5-9850-4879471d652b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Flavor pref 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 09:00:54.436185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-163f22cc-d89f-42a5-9850-4879471d652b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Image pref 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 09:00:54.436472 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-163f22cc-d89f-42a5-9850-4879471d652b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 09:00:54.449843 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-163f22cc-d89f-42a5-9850-4879471d652b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:54.450291 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-163f22cc-d89f-42a5-9850-4879471d652b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:54.451117 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-163f22cc-d89f-42a5-9850-4879471d652b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:54.451905 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-163f22cc-d89f-42a5-9850-4879471d652b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:54.472267 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-163f22cc-d89f-42a5-9850-4879471d652b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Getting quotas for project 4c3ecf1efb8748a0af09e501e2b9d81b. Resources: {'ram', 'cores', 'instances'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 09:00:54.477365 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-163f22cc-d89f-42a5-9850-4879471d652b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Getting quotas for user 61c06d41d371486c9856a17c5b2aee20 and project 4c3ecf1efb8748a0af09e501e2b9d81b. Resources: {'ram', 'cores', 'instances'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 09:00:54.538687 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-163f22cc-d89f-42a5-9850-4879471d652b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Going to run 1 instances... {{(pid=129875) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 09:00:54.540985 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-163f22cc-d89f-42a5-9850-4879471d652b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: cfdb821c-9155-4446-a423-8e8ddddc0902] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='62268ed6-46dd-41fc-9c9d-aa005b7bc9c2',volume_size=None,volume_type=None)] {{(pid=129875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 09:00:55.025521 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-163f22cc-d89f-42a5-9850-4879471d652b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.100397 Jun 17 09:00:55.026493 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 530/1066] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jun 17 09:00:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 09:00:55.036807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-3d4557c7-615e-4479-9102-14c8e67e382e tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:00:55.038129 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-3d4557c7-615e-4479-9102-14c8e67e382e tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: cfdb821c-9155-4446-a423-8e8ddddc0902] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:55.099311 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-3d4557c7-615e-4479-9102-14c8e67e382e tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:00:55.104391 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-3d4557c7-615e-4479-9102-14c8e67e382e tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902" status: 200 len: 1094 microversion: 2.1 time: 0.071425 Jun 17 09:00:55.105051 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 537/1067] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:00:55 2022] GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:00:55.718577 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d5af4216-dab7-4ba0-a589-ec8227ab4d39 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:00:55.725412 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d5af4216-dab7-4ba0-a589-ec8227ab4d39 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:55.725793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d5af4216-dab7-4ba0-a589-ec8227ab4d39 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:55.784836 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-d5af4216-dab7-4ba0-a589-ec8227ab4d39 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Going to try to stop instance {{(pid=129875) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 17 09:00:56.041902 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-d5af4216-dab7-4ba0-a589-ec8227ab4d39 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "POST /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475/action" status: 202 len: 0 microversion: 2.1 time: 0.326912 Jun 17 09:00:56.045460 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 531/1068] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jun 17 09:00:55 2022] POST /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 09:00:56.056482 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-798e1395-c21d-4368-886d-bc416c116623 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:00:56.057126 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-798e1395-c21d-4368-886d-bc416c116623 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:56.072739 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-798e1395-c21d-4368-886d-bc416c116623 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:56.073341 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-798e1395-c21d-4368-886d-bc416c116623 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:56.074268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-798e1395-c21d-4368-886d-bc416c116623 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:56.074715 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-798e1395-c21d-4368-886d-bc416c116623 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:56.125830 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-ab888d67-ad5e-4cf9-a1bf-5e1908995854 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:00:56.126537 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-ab888d67-ad5e-4cf9-a1bf-5e1908995854 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: cfdb821c-9155-4446-a423-8e8ddddc0902] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:56.132811 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ab888d67-ad5e-4cf9-a1bf-5e1908995854 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:56.133282 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ab888d67-ad5e-4cf9-a1bf-5e1908995854 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:56.134049 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ab888d67-ad5e-4cf9-a1bf-5e1908995854 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:56.134566 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ab888d67-ad5e-4cf9-a1bf-5e1908995854 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:56.220866 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-ab888d67-ad5e-4cf9-a1bf-5e1908995854 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:00:56.228513 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-ab888d67-ad5e-4cf9-a1bf-5e1908995854 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902" status: 200 len: 1144 microversion: 2.1 time: 0.109544 Jun 17 09:00:56.229088 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 532/1069] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:00:56 2022] GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902 => generated 1144 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 09:00:56.251101 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-798e1395-c21d-4368-886d-bc416c116623 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:00:56.261550 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-798e1395-c21d-4368-886d-bc416c116623 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1723 microversion: 2.1 time: 0.210503 Jun 17 09:00:56.262177 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 538/1070] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:00:56 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:00:57.246414 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-2e616ed6-5acc-4c46-b5ad-5a09672e9dbe tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:00:57.247381 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-2e616ed6-5acc-4c46-b5ad-5a09672e9dbe tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: cfdb821c-9155-4446-a423-8e8ddddc0902] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:57.254270 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2e616ed6-5acc-4c46-b5ad-5a09672e9dbe tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:57.254735 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2e616ed6-5acc-4c46-b5ad-5a09672e9dbe tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:57.255573 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2e616ed6-5acc-4c46-b5ad-5a09672e9dbe tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:57.256163 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2e616ed6-5acc-4c46-b5ad-5a09672e9dbe tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:57.279695 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-79d02097-95ca-40d6-a0e2-1520acb70921 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:00:57.284758 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-79d02097-95ca-40d6-a0e2-1520acb70921 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:57.288527 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-79d02097-95ca-40d6-a0e2-1520acb70921 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:57.289105 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-79d02097-95ca-40d6-a0e2-1520acb70921 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:57.289982 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-79d02097-95ca-40d6-a0e2-1520acb70921 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:57.291122 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-79d02097-95ca-40d6-a0e2-1520acb70921 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:57.330167 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2e616ed6-5acc-4c46-b5ad-5a09672e9dbe tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:00:57.337959 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-2e616ed6-5acc-4c46-b5ad-5a09672e9dbe tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902" status: 200 len: 1200 microversion: 2.1 time: 0.095731 Jun 17 09:00:57.338533 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 533/1071] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:00:57 2022] GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902 => generated 1200 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:00:57.453369 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-79d02097-95ca-40d6-a0e2-1520acb70921 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:00:57.463746 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-79d02097-95ca-40d6-a0e2-1520acb70921 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1723 microversion: 2.1 time: 0.188421 Jun 17 09:00:57.464444 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 539/1072] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:00:57 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 09:00:58.355953 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0d399e65-2e34-4b3d-809d-0187fd7188b2 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:00:58.356611 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0d399e65-2e34-4b3d-809d-0187fd7188b2 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: cfdb821c-9155-4446-a423-8e8ddddc0902] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:58.364262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0d399e65-2e34-4b3d-809d-0187fd7188b2 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:58.364807 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0d399e65-2e34-4b3d-809d-0187fd7188b2 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:58.365744 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0d399e65-2e34-4b3d-809d-0187fd7188b2 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:58.366243 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0d399e65-2e34-4b3d-809d-0187fd7188b2 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:58.485897 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-49d5fd2c-b282-4d03-9cdb-5b3c713df8aa tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:00:58.492351 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-49d5fd2c-b282-4d03-9cdb-5b3c713df8aa tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:58.497933 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-49d5fd2c-b282-4d03-9cdb-5b3c713df8aa tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:58.503405 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-49d5fd2c-b282-4d03-9cdb-5b3c713df8aa tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:58.505301 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-49d5fd2c-b282-4d03-9cdb-5b3c713df8aa tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:58.505955 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-49d5fd2c-b282-4d03-9cdb-5b3c713df8aa tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:58.574781 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0d399e65-2e34-4b3d-809d-0187fd7188b2 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:00:58.582682 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0d399e65-2e34-4b3d-809d-0187fd7188b2 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902" status: 200 len: 1277 microversion: 2.1 time: 0.230579 Jun 17 09:00:58.583792 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 534/1073] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:00:58 2022] GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902 => generated 1277 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:00:58.660880 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-49d5fd2c-b282-4d03-9cdb-5b3c713df8aa tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:00:58.668893 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-49d5fd2c-b282-4d03-9cdb-5b3c713df8aa tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1723 microversion: 2.1 time: 0.191008 Jun 17 09:00:58.669458 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 540/1074] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:00:58 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 09:00:59.149899 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-9fc51b9f-5393-4de9-9702-baaa413b18d5 req-cb0fc286-1adf-40c7-9b3c-95b5f16503c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfdb821c-9155-4446-a423-8e8ddddc0902", "tag": "b4cd31ab-2201-4188-9f14-62d62fa9247e"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:00:59.160793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-9fc51b9f-5393-4de9-9702-baaa413b18d5 req-cb0fc286-1adf-40c7-9b3c-95b5f16503c4 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:59.161616 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-9fc51b9f-5393-4de9-9702-baaa413b18d5 req-cb0fc286-1adf-40c7-9b3c-95b5f16503c4 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:59.174435 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-9fc51b9f-5393-4de9-9702-baaa413b18d5 req-cb0fc286-1adf-40c7-9b3c-95b5f16503c4 service nova] Creating event network-changed:b4cd31ab-2201-4188-9f14-62d62fa9247e for instance cfdb821c-9155-4446-a423-8e8ddddc0902 on hv-cinder-79760 Jun 17 09:00:59.179598 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-9fc51b9f-5393-4de9-9702-baaa413b18d5 req-cb0fc286-1adf-40c7-9b3c-95b5f16503c4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034461 Jun 17 09:00:59.180836 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 535/1075] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 09:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:00:59.603293 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-dd1157a1-4da4-4793-afa1-c57f3026c2a1 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:00:59.603933 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-dd1157a1-4da4-4793-afa1-c57f3026c2a1 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: cfdb821c-9155-4446-a423-8e8ddddc0902] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:59.610795 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dd1157a1-4da4-4793-afa1-c57f3026c2a1 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:59.611194 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dd1157a1-4da4-4793-afa1-c57f3026c2a1 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:59.611982 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dd1157a1-4da4-4793-afa1-c57f3026c2a1 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:59.612417 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dd1157a1-4da4-4793-afa1-c57f3026c2a1 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:59.690665 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-966ddaaa-3ded-48da-9e4d-e6e44a8d9306 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:00:59.691437 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-966ddaaa-3ded-48da-9e4d-e6e44a8d9306 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:00:59.699231 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-966ddaaa-3ded-48da-9e4d-e6e44a8d9306 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:59.699891 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-966ddaaa-3ded-48da-9e4d-e6e44a8d9306 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:59.700687 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-966ddaaa-3ded-48da-9e4d-e6e44a8d9306 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:00:59.701112 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-966ddaaa-3ded-48da-9e4d-e6e44a8d9306 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:00:59.805956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-dd1157a1-4da4-4793-afa1-c57f3026c2a1 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:00:59.816284 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-dd1157a1-4da4-4793-afa1-c57f3026c2a1 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902" status: 200 len: 1265 microversion: 2.1 time: 0.216860 Jun 17 09:00:59.816970 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 541/1076] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:00:59 2022] GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 09:00:59.866695 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-966ddaaa-3ded-48da-9e4d-e6e44a8d9306 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:00:59.874828 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-966ddaaa-3ded-48da-9e4d-e6e44a8d9306 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1723 microversion: 2.1 time: 0.191786 Jun 17 09:00:59.876029 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 536/1077] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:00:59 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 09:01:00.832957 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-4213190c-dce0-4380-9126-5c758a3acf21 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:00.833574 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-4213190c-dce0-4380-9126-5c758a3acf21 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: cfdb821c-9155-4446-a423-8e8ddddc0902] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:00.840088 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4213190c-dce0-4380-9126-5c758a3acf21 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:00.840537 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4213190c-dce0-4380-9126-5c758a3acf21 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:00.841289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4213190c-dce0-4380-9126-5c758a3acf21 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:00.841723 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4213190c-dce0-4380-9126-5c758a3acf21 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:00.893367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-f07c1725-e2b6-4135-810a-0524f5c8d975 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:00.894061 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-f07c1725-e2b6-4135-810a-0524f5c8d975 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:00.900258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f07c1725-e2b6-4135-810a-0524f5c8d975 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:00.900704 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f07c1725-e2b6-4135-810a-0524f5c8d975 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:00.901683 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f07c1725-e2b6-4135-810a-0524f5c8d975 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:00.902170 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f07c1725-e2b6-4135-810a-0524f5c8d975 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:01.014816 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-4213190c-dce0-4380-9126-5c758a3acf21 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:01.022983 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-4213190c-dce0-4380-9126-5c758a3acf21 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902" status: 200 len: 1265 microversion: 2.1 time: 0.193912 Jun 17 09:01:01.023697 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 542/1078] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:00 2022] GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:01:01.059550 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f07c1725-e2b6-4135-810a-0524f5c8d975 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:01.068022 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-f07c1725-e2b6-4135-810a-0524f5c8d975 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1723 microversion: 2.1 time: 0.179111 Jun 17 09:01:01.068591 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 537/1079] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:00 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 09:01:02.040824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e6b370a6-8b16-4080-82a1-78c5f0484394 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:02.041443 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-e6b370a6-8b16-4080-82a1-78c5f0484394 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: cfdb821c-9155-4446-a423-8e8ddddc0902] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:02.048927 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e6b370a6-8b16-4080-82a1-78c5f0484394 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:02.049383 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e6b370a6-8b16-4080-82a1-78c5f0484394 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:02.050243 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e6b370a6-8b16-4080-82a1-78c5f0484394 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:02.050682 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e6b370a6-8b16-4080-82a1-78c5f0484394 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:02.085364 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1728cd5a-e81f-4072-83f0-f405597c1344 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:02.085971 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-1728cd5a-e81f-4072-83f0-f405597c1344 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:02.092474 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1728cd5a-e81f-4072-83f0-f405597c1344 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:02.092922 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1728cd5a-e81f-4072-83f0-f405597c1344 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:02.093696 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1728cd5a-e81f-4072-83f0-f405597c1344 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:02.094669 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1728cd5a-e81f-4072-83f0-f405597c1344 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:02.240911 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e6b370a6-8b16-4080-82a1-78c5f0484394 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:02.248747 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-e6b370a6-8b16-4080-82a1-78c5f0484394 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902" status: 200 len: 1265 microversion: 2.1 time: 0.212017 Jun 17 09:01:02.249323 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 543/1080] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:02 2022] GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:01:02.268105 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-1728cd5a-e81f-4072-83f0-f405597c1344 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:02.276107 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-1728cd5a-e81f-4072-83f0-f405597c1344 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1723 microversion: 2.1 time: 0.194729 Jun 17 09:01:02.276798 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 538/1081] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:02 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 09:01:03.265719 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-56527e8d-0ba2-4635-bce0-97cb964820f9 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:03.266469 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-56527e8d-0ba2-4635-bce0-97cb964820f9 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: cfdb821c-9155-4446-a423-8e8ddddc0902] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:03.272853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-56527e8d-0ba2-4635-bce0-97cb964820f9 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:03.273302 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-56527e8d-0ba2-4635-bce0-97cb964820f9 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:03.274058 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-56527e8d-0ba2-4635-bce0-97cb964820f9 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:03.274491 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-56527e8d-0ba2-4635-bce0-97cb964820f9 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:03.293728 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-091108d1-6593-4276-9860-48a49606f262 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:03.294397 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-091108d1-6593-4276-9860-48a49606f262 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:03.301716 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-091108d1-6593-4276-9860-48a49606f262 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:03.302162 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-091108d1-6593-4276-9860-48a49606f262 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:03.302932 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-091108d1-6593-4276-9860-48a49606f262 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:03.303391 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-091108d1-6593-4276-9860-48a49606f262 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:03.465319 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-56527e8d-0ba2-4635-bce0-97cb964820f9 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:03.473253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-56527e8d-0ba2-4635-bce0-97cb964820f9 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902" status: 200 len: 1265 microversion: 2.1 time: 0.211706 Jun 17 09:01:03.473825 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 544/1082] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:03 2022] GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:01:03.486566 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-091108d1-6593-4276-9860-48a49606f262 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:03.494574 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-091108d1-6593-4276-9860-48a49606f262 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1723 microversion: 2.1 time: 0.204663 Jun 17 09:01:03.495127 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 539/1083] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:03 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 09:01:04.490186 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-8fcae21a-46fc-441c-a468-b4e064ff0b08 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:04.490802 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-8fcae21a-46fc-441c-a468-b4e064ff0b08 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: cfdb821c-9155-4446-a423-8e8ddddc0902] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:04.497424 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8fcae21a-46fc-441c-a468-b4e064ff0b08 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:04.499174 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8fcae21a-46fc-441c-a468-b4e064ff0b08 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:04.499174 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8fcae21a-46fc-441c-a468-b4e064ff0b08 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:04.499174 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8fcae21a-46fc-441c-a468-b4e064ff0b08 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:04.511692 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-de2ed695-83ac-4526-a4e2-96f8101734d3 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:04.512491 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-de2ed695-83ac-4526-a4e2-96f8101734d3 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:04.515538 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=2 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:01:04.516190 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=6 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:01:04.520503 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-de2ed695-83ac-4526-a4e2-96f8101734d3 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:04.520952 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-de2ed695-83ac-4526-a4e2-96f8101734d3 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:04.521708 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-de2ed695-83ac-4526-a4e2-96f8101734d3 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:04.522140 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-de2ed695-83ac-4526-a4e2-96f8101734d3 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:04.703230 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-8fcae21a-46fc-441c-a468-b4e064ff0b08 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:04.710951 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-de2ed695-83ac-4526-a4e2-96f8101734d3 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:04.711319 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-8fcae21a-46fc-441c-a468-b4e064ff0b08 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902" status: 200 len: 1265 microversion: 2.1 time: 0.225033 Jun 17 09:01:04.711915 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 545/1084] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:04 2022] GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:01:04.714413 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:01:04.720279 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-de2ed695-83ac-4526-a4e2-96f8101734d3 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1723 microversion: 2.1 time: 0.211606 Jun 17 09:01:04.720965 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 540/1085] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:04 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 09:01:05.728707 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-6496cb1a-2bfc-44fa-97e9-a1577a16f651 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:05.729254 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-6496cb1a-2bfc-44fa-97e9-a1577a16f651 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: cfdb821c-9155-4446-a423-8e8ddddc0902] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:05.731195 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=2 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:01:05.737769 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6496cb1a-2bfc-44fa-97e9-a1577a16f651 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:05.737995 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-6620d421-721d-452e-9667-830d0459129d tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:05.738538 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6496cb1a-2bfc-44fa-97e9-a1577a16f651 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:05.738664 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-6620d421-721d-452e-9667-830d0459129d tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:05.739038 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6496cb1a-2bfc-44fa-97e9-a1577a16f651 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:05.739519 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6496cb1a-2bfc-44fa-97e9-a1577a16f651 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:05.745708 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6620d421-721d-452e-9667-830d0459129d tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:05.746158 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6620d421-721d-452e-9667-830d0459129d tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:05.746936 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6620d421-721d-452e-9667-830d0459129d tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:05.747390 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6620d421-721d-452e-9667-830d0459129d tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:05.942242 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-6496cb1a-2bfc-44fa-97e9-a1577a16f651 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:05.945697 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-6620d421-721d-452e-9667-830d0459129d tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:05.950075 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-6496cb1a-2bfc-44fa-97e9-a1577a16f651 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902" status: 200 len: 1265 microversion: 2.1 time: 0.225298 Jun 17 09:01:05.950846 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 546/1086] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:05 2022] GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 09:01:05.955960 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-6620d421-721d-452e-9667-830d0459129d tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1723 microversion: 2.1 time: 0.221086 Jun 17 09:01:05.955960 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 541/1087] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:05 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 09:01:06.966585 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-2b7cca43-7f2c-4f51-a75f-8ab160157b33 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:06.967195 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-2b7cca43-7f2c-4f51-a75f-8ab160157b33 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: cfdb821c-9155-4446-a423-8e8ddddc0902] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:06.971409 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-59cd856c-2d94-40b5-aa5e-992708b05139 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:06.972032 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-59cd856c-2d94-40b5-aa5e-992708b05139 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:06.974053 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2b7cca43-7f2c-4f51-a75f-8ab160157b33 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:06.974484 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2b7cca43-7f2c-4f51-a75f-8ab160157b33 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:06.975253 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2b7cca43-7f2c-4f51-a75f-8ab160157b33 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:06.975715 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2b7cca43-7f2c-4f51-a75f-8ab160157b33 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:06.978473 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-59cd856c-2d94-40b5-aa5e-992708b05139 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:06.978930 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-59cd856c-2d94-40b5-aa5e-992708b05139 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:06.979735 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-59cd856c-2d94-40b5-aa5e-992708b05139 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:06.980179 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-59cd856c-2d94-40b5-aa5e-992708b05139 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:07.173775 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-2b7cca43-7f2c-4f51-a75f-8ab160157b33 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:07.181494 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-59cd856c-2d94-40b5-aa5e-992708b05139 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:07.181806 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-2b7cca43-7f2c-4f51-a75f-8ab160157b33 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902" status: 200 len: 1265 microversion: 2.1 time: 0.218992 Jun 17 09:01:07.182420 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 547/1088] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:06 2022] GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:01:07.192461 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-59cd856c-2d94-40b5-aa5e-992708b05139 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1723 microversion: 2.1 time: 0.225232 Jun 17 09:01:07.193044 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 542/1089] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:06 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 09:01:08.198186 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a1c73166-f8b6-4ad1-8275-32ac458756fb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:08.198897 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a1c73166-f8b6-4ad1-8275-32ac458756fb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: cfdb821c-9155-4446-a423-8e8ddddc0902] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:08.206136 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a1c73166-f8b6-4ad1-8275-32ac458756fb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:08.206592 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a1c73166-f8b6-4ad1-8275-32ac458756fb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:08.207380 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a1c73166-f8b6-4ad1-8275-32ac458756fb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:08.207826 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a1c73166-f8b6-4ad1-8275-32ac458756fb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:08.211789 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-7ac73212-ddb0-4d45-91ed-3e40ffd1f48b tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:08.212411 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-7ac73212-ddb0-4d45-91ed-3e40ffd1f48b tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:08.218858 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7ac73212-ddb0-4d45-91ed-3e40ffd1f48b tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:08.220020 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7ac73212-ddb0-4d45-91ed-3e40ffd1f48b tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:08.221131 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7ac73212-ddb0-4d45-91ed-3e40ffd1f48b tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:08.221798 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7ac73212-ddb0-4d45-91ed-3e40ffd1f48b tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:08.412541 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a1c73166-f8b6-4ad1-8275-32ac458756fb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:08.420476 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-7ac73212-ddb0-4d45-91ed-3e40ffd1f48b tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:08.421298 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a1c73166-f8b6-4ad1-8275-32ac458756fb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902" status: 200 len: 1265 microversion: 2.1 time: 0.227064 Jun 17 09:01:08.422080 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 548/1090] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:08 2022] GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902 => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:01:08.431478 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-7ac73212-ddb0-4d45-91ed-3e40ffd1f48b tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1723 microversion: 2.1 time: 0.225157 Jun 17 09:01:08.432061 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 543/1091] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:08 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:01:09.438917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-01b07fad-eb81-4660-b19e-9ae650bde4e3 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:09.439609 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-01b07fad-eb81-4660-b19e-9ae650bde4e3 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: cfdb821c-9155-4446-a423-8e8ddddc0902] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:09.446440 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-01b07fad-eb81-4660-b19e-9ae650bde4e3 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:09.446896 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-01b07fad-eb81-4660-b19e-9ae650bde4e3 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:09.447704 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-01b07fad-eb81-4660-b19e-9ae650bde4e3 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:09.447883 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-8c670023-a18e-4367-9464-96d0b45f4fb7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:09.448380 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-01b07fad-eb81-4660-b19e-9ae650bde4e3 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:09.449164 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-8c670023-a18e-4367-9464-96d0b45f4fb7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:09.455750 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8c670023-a18e-4367-9464-96d0b45f4fb7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:09.456236 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8c670023-a18e-4367-9464-96d0b45f4fb7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:09.457005 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8c670023-a18e-4367-9464-96d0b45f4fb7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:09.457440 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8c670023-a18e-4367-9464-96d0b45f4fb7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:09.645517 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-8c670023-a18e-4367-9464-96d0b45f4fb7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:09.649521 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-01b07fad-eb81-4660-b19e-9ae650bde4e3 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:09.652983 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:01:09.653978 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-8c670023-a18e-4367-9464-96d0b45f4fb7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1723 microversion: 2.1 time: 0.209813 Jun 17 09:01:09.654553 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 544/1092] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:09 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:01:09.657533 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-01b07fad-eb81-4660-b19e-9ae650bde4e3 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902" status: 200 len: 1265 microversion: 2.1 time: 0.223293 Jun 17 09:01:09.658157 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 549/1093] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:09 2022] GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:01:09.947015 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-b886013c-418a-4d6b-8ca5-394794cfd4be req-005f97de-d9eb-4a01-9af9-b3c571abe0e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfdb821c-9155-4446-a423-8e8ddddc0902", "name": "network-vif-plugged", "status": "completed", "tag": "b4cd31ab-2201-4188-9f14-62d62fa9247e"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:01:09.955288 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-b886013c-418a-4d6b-8ca5-394794cfd4be req-005f97de-d9eb-4a01-9af9-b3c571abe0e5 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:09.959131 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-b886013c-418a-4d6b-8ca5-394794cfd4be req-005f97de-d9eb-4a01-9af9-b3c571abe0e5 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:09.966246 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-b886013c-418a-4d6b-8ca5-394794cfd4be req-005f97de-d9eb-4a01-9af9-b3c571abe0e5 service nova] Creating event network-vif-plugged:b4cd31ab-2201-4188-9f14-62d62fa9247e for instance cfdb821c-9155-4446-a423-8e8ddddc0902 on hv-cinder-79760 Jun 17 09:01:09.971851 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-b886013c-418a-4d6b-8ca5-394794cfd4be req-005f97de-d9eb-4a01-9af9-b3c571abe0e5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029758 Jun 17 09:01:09.972428 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 545/1094] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 09:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:01:10.672043 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-ea86530b-4a63-4364-b69d-b0666bb62149 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:10.672644 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-ea86530b-4a63-4364-b69d-b0666bb62149 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:10.679562 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ea86530b-4a63-4364-b69d-b0666bb62149 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:10.680280 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ea86530b-4a63-4364-b69d-b0666bb62149 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:10.681052 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ea86530b-4a63-4364-b69d-b0666bb62149 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:10.681491 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ea86530b-4a63-4364-b69d-b0666bb62149 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:10.683652 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a6bae286-6d1a-4462-90b1-b21efeed45fb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:10.684351 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-a6bae286-6d1a-4462-90b1-b21efeed45fb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: cfdb821c-9155-4446-a423-8e8ddddc0902] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:10.691840 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a6bae286-6d1a-4462-90b1-b21efeed45fb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:10.692288 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a6bae286-6d1a-4462-90b1-b21efeed45fb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:10.693059 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a6bae286-6d1a-4462-90b1-b21efeed45fb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:10.693496 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a6bae286-6d1a-4462-90b1-b21efeed45fb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:10.874919 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-ea86530b-4a63-4364-b69d-b0666bb62149 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:10.883966 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-ea86530b-4a63-4364-b69d-b0666bb62149 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1723 microversion: 2.1 time: 0.216229 Jun 17 09:01:10.884584 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 550/1095] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:10 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:01:10.890896 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a6bae286-6d1a-4462-90b1-b21efeed45fb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:10.899112 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-a6bae286-6d1a-4462-90b1-b21efeed45fb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902" status: 200 len: 1265 microversion: 2.1 time: 0.220260 Jun 17 09:01:10.899744 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 546/1096] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:10 2022] GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 09:01:11.901382 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-672520fa-f03a-4b89-9bb1-ec5ea0ac229c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:11.901978 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-672520fa-f03a-4b89-9bb1-ec5ea0ac229c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:11.908708 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-672520fa-f03a-4b89-9bb1-ec5ea0ac229c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:11.909168 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-672520fa-f03a-4b89-9bb1-ec5ea0ac229c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:11.909908 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-672520fa-f03a-4b89-9bb1-ec5ea0ac229c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:11.910372 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-672520fa-f03a-4b89-9bb1-ec5ea0ac229c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:11.918345 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0348a1a2-ca3d-4427-998e-576f9783ffa3 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:11.919030 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0348a1a2-ca3d-4427-998e-576f9783ffa3 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: cfdb821c-9155-4446-a423-8e8ddddc0902] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:11.926405 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0348a1a2-ca3d-4427-998e-576f9783ffa3 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:11.926860 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0348a1a2-ca3d-4427-998e-576f9783ffa3 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:11.928941 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0348a1a2-ca3d-4427-998e-576f9783ffa3 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:11.928941 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0348a1a2-ca3d-4427-998e-576f9783ffa3 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:12.108366 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-672520fa-f03a-4b89-9bb1-ec5ea0ac229c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:12.117090 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-672520fa-f03a-4b89-9bb1-ec5ea0ac229c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1700 microversion: 2.1 time: 0.219605 Jun 17 09:01:12.117664 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 551/1097] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:11 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1700 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:01:12.129025 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0348a1a2-ca3d-4427-998e-576f9783ffa3 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:12.133320 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-0053e161-5f2b-476b-a261-95f668d5128d tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:01:12.137100 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0348a1a2-ca3d-4427-998e-576f9783ffa3 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902" status: 200 len: 1450 microversion: 2.1 time: 0.224001 Jun 17 09:01:12.137699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 547/1098] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:11 2022] GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902 => generated 1450 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 09:01:12.139925 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0053e161-5f2b-476b-a261-95f668d5128d tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:12.140381 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0053e161-5f2b-476b-a261-95f668d5128d tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:12.160182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-2daa75f0-ebd4-4c61-8ff8-f11055660fe5 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:12.160708 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-2daa75f0-ebd4-4c61-8ff8-f11055660fe5 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: cfdb821c-9155-4446-a423-8e8ddddc0902] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:12.166646 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2daa75f0-ebd4-4c61-8ff8-f11055660fe5 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:12.167102 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2daa75f0-ebd4-4c61-8ff8-f11055660fe5 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:12.167889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2daa75f0-ebd4-4c61-8ff8-f11055660fe5 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:12.168323 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2daa75f0-ebd4-4c61-8ff8-f11055660fe5 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:12.201477 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-0053e161-5f2b-476b-a261-95f668d5128d tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Going to try to start instance {{(pid=129876) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 17 09:01:12.296515 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2daa75f0-ebd4-4c61-8ff8-f11055660fe5 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:12.304668 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-2daa75f0-ebd4-4c61-8ff8-f11055660fe5 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902" status: 200 len: 1450 microversion: 2.1 time: 0.149094 Jun 17 09:01:12.305506 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 548/1099] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:12 2022] GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902 => generated 1450 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 09:01:12.398530 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-0053e161-5f2b-476b-a261-95f668d5128d tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "POST /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475/action" status: 202 len: 0 microversion: 2.1 time: 0.268905 Jun 17 09:01:12.399103 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 552/1100] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jun 17 09:01:12 2022] POST /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 09:01:12.408044 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a0f4e4ad-a89d-478c-90fc-8533ecabe7ee tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:12.408650 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-a0f4e4ad-a89d-478c-90fc-8533ecabe7ee tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:12.414792 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a0f4e4ad-a89d-478c-90fc-8533ecabe7ee tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:12.415171 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a0f4e4ad-a89d-478c-90fc-8533ecabe7ee tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:12.416009 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a0f4e4ad-a89d-478c-90fc-8533ecabe7ee tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:12.416441 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a0f4e4ad-a89d-478c-90fc-8533ecabe7ee tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:12.608103 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a0f4e4ad-a89d-478c-90fc-8533ecabe7ee tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:12.616764 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-a0f4e4ad-a89d-478c-90fc-8533ecabe7ee tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1709 microversion: 2.1 time: 0.212740 Jun 17 09:01:12.617353 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 549/1101] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:12 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1709 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:01:13.635576 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-dd1b9188-123f-4b30-bf54-40387a725599 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:13.639920 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-dd1b9188-123f-4b30-bf54-40387a725599 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:13.643277 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dd1b9188-123f-4b30-bf54-40387a725599 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:13.643769 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dd1b9188-123f-4b30-bf54-40387a725599 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:13.644568 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dd1b9188-123f-4b30-bf54-40387a725599 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:13.645061 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-dd1b9188-123f-4b30-bf54-40387a725599 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:13.919602 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-dd1b9188-123f-4b30-bf54-40387a725599 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:13.928266 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-dd1b9188-123f-4b30-bf54-40387a725599 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1709 microversion: 2.1 time: 0.297401 Jun 17 09:01:13.928910 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 553/1102] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:13 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1709 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:01:14.681989 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-379d4a79-040c-4191-9170-5c0f7b894db7 req-7879b237-75d7-4b5d-b0c6-975e87738698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfdb821c-9155-4446-a423-8e8ddddc0902", "tag": "b4cd31ab-2201-4188-9f14-62d62fa9247e"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:01:14.690723 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-379d4a79-040c-4191-9170-5c0f7b894db7 req-7879b237-75d7-4b5d-b0c6-975e87738698 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:14.691164 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-379d4a79-040c-4191-9170-5c0f7b894db7 req-7879b237-75d7-4b5d-b0c6-975e87738698 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:14.702505 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-379d4a79-040c-4191-9170-5c0f7b894db7 req-7879b237-75d7-4b5d-b0c6-975e87738698 service nova] Creating event network-changed:b4cd31ab-2201-4188-9f14-62d62fa9247e for instance cfdb821c-9155-4446-a423-8e8ddddc0902 on hv-cinder-79760 Jun 17 09:01:14.708778 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-379d4a79-040c-4191-9170-5c0f7b894db7 req-7879b237-75d7-4b5d-b0c6-975e87738698 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030557 Jun 17 09:01:14.709646 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 550/1103] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 09:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 09:01:14.946249 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-aada2982-b888-4e91-9b45-541c410587de tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:14.946871 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-aada2982-b888-4e91-9b45-541c410587de tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:14.954694 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-aada2982-b888-4e91-9b45-541c410587de tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:14.955538 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-aada2982-b888-4e91-9b45-541c410587de tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:14.956348 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-aada2982-b888-4e91-9b45-541c410587de tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:14.957039 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-aada2982-b888-4e91-9b45-541c410587de tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:15.106032 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-aada2982-b888-4e91-9b45-541c410587de tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:15.115082 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-aada2982-b888-4e91-9b45-541c410587de tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1713 microversion: 2.1 time: 0.172665 Jun 17 09:01:15.115704 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 554/1104] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:14 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1713 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:01:48.168890 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:01:48.169742 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=52 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:01:48.174015 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0179c129-bc70-4c69-958c-5732d14196f0 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:48.174598 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0179c129-bc70-4c69-958c-5732d14196f0 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:48.181822 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0179c129-bc70-4c69-958c-5732d14196f0 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:48.182297 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0179c129-bc70-4c69-958c-5732d14196f0 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:48.183385 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0179c129-bc70-4c69-958c-5732d14196f0 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:48.183836 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0179c129-bc70-4c69-958c-5732d14196f0 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:48.467764 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-0179c129-bc70-4c69-958c-5732d14196f0 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lazy-loading 'services' on Instance uuid d29e3483-56d1-40fb-a15f-5a57da6e5475 {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 09:01:48.821273 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0179c129-bc70-4c69-958c-5732d14196f0 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475/os-volume_attachments/f5451e03-c0dc-4ebf-8685-1b412f12191f" status: 202 len: 0 microversion: 2.1 time: 0.654244 Jun 17 09:01:48.821855 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 551/1105] 10.222.0.78 () {58 vars in 1415 bytes} [Fri Jun 17 09:01:48 2022] DELETE /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475/os-volume_attachments/f5451e03-c0dc-4ebf-8685-1b412f12191f => generated 0 bytes in 656 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 09:01:49.935137 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-896d7899-3a6f-439e-ac32-b6535e166934 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:01:49.955551 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_api:SELECT=46 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:01:49.955551 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:01:49.955551 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-896d7899-3a6f-439e-ac32-b6535e166934 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:49.955551 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-896d7899-3a6f-439e-ac32-b6535e166934 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:49.969264 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-896d7899-3a6f-439e-ac32-b6535e166934 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Going to try to stop instance {{(pid=129876) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 17 09:01:50.375144 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-896d7899-3a6f-439e-ac32-b6535e166934 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "POST /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475/action" status: 202 len: 0 microversion: 2.1 time: 0.443965 Jun 17 09:01:50.375820 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 555/1106] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jun 17 09:01:49 2022] POST /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 09:01:50.385100 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0d083429-d417-4999-b95f-84fcbaa4e299 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:50.386952 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0d083429-d417-4999-b95f-84fcbaa4e299 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:50.393356 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0d083429-d417-4999-b95f-84fcbaa4e299 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:50.393744 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0d083429-d417-4999-b95f-84fcbaa4e299 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:50.394528 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0d083429-d417-4999-b95f-84fcbaa4e299 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:50.394971 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0d083429-d417-4999-b95f-84fcbaa4e299 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:50.533912 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0d083429-d417-4999-b95f-84fcbaa4e299 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:50.542437 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0d083429-d417-4999-b95f-84fcbaa4e299 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1677 microversion: 2.1 time: 0.161918 Jun 17 09:01:50.543010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 552/1107] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:50 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 09:01:51.561771 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-29e22007-e2fe-4097-bf1f-d5ffca4dbfef tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:51.562589 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-29e22007-e2fe-4097-bf1f-d5ffca4dbfef tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:51.568791 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-29e22007-e2fe-4097-bf1f-d5ffca4dbfef tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:51.569248 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-29e22007-e2fe-4097-bf1f-d5ffca4dbfef tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:51.570035 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-29e22007-e2fe-4097-bf1f-d5ffca4dbfef tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:51.570473 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-29e22007-e2fe-4097-bf1f-d5ffca4dbfef tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:51.803668 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-29e22007-e2fe-4097-bf1f-d5ffca4dbfef tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:51.811940 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-29e22007-e2fe-4097-bf1f-d5ffca4dbfef tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1677 microversion: 2.1 time: 0.255783 Jun 17 09:01:51.812507 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 556/1108] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:51 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1677 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:01:52.829335 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-7ed61a65-9eaa-42d9-92db-7e4d8b1c6cf5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:52.829931 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-7ed61a65-9eaa-42d9-92db-7e4d8b1c6cf5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:52.836486 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7ed61a65-9eaa-42d9-92db-7e4d8b1c6cf5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:52.836937 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7ed61a65-9eaa-42d9-92db-7e4d8b1c6cf5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:52.837706 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7ed61a65-9eaa-42d9-92db-7e4d8b1c6cf5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:52.838146 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7ed61a65-9eaa-42d9-92db-7e4d8b1c6cf5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:52.969766 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-7ed61a65-9eaa-42d9-92db-7e4d8b1c6cf5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:52.977380 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-7ed61a65-9eaa-42d9-92db-7e4d8b1c6cf5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1677 microversion: 2.1 time: 0.151942 Jun 17 09:01:52.977947 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 553/1109] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:52 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:01:53.995303 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-5617bf6a-2606-4209-8397-fb382f909280 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:53.996003 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-5617bf6a-2606-4209-8397-fb382f909280 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:54.002479 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5617bf6a-2606-4209-8397-fb382f909280 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:54.002928 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5617bf6a-2606-4209-8397-fb382f909280 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:54.003711 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5617bf6a-2606-4209-8397-fb382f909280 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:54.004148 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5617bf6a-2606-4209-8397-fb382f909280 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:54.137134 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-5617bf6a-2606-4209-8397-fb382f909280 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:54.145011 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-5617bf6a-2606-4209-8397-fb382f909280 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1677 microversion: 2.1 time: 0.153528 Jun 17 09:01:54.145769 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 557/1110] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:53 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:01:55.163430 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-8ee28301-4c15-4c88-a98f-3abdac7a6df1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:55.163972 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-8ee28301-4c15-4c88-a98f-3abdac7a6df1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:55.170659 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8ee28301-4c15-4c88-a98f-3abdac7a6df1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:55.171107 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8ee28301-4c15-4c88-a98f-3abdac7a6df1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:55.171915 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8ee28301-4c15-4c88-a98f-3abdac7a6df1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:55.172350 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8ee28301-4c15-4c88-a98f-3abdac7a6df1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:55.306933 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-8ee28301-4c15-4c88-a98f-3abdac7a6df1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:55.315568 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-8ee28301-4c15-4c88-a98f-3abdac7a6df1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1677 microversion: 2.1 time: 0.155940 Jun 17 09:01:55.316154 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 554/1111] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:55 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:01:56.333900 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-c5e9fb5d-a270-40e0-b014-084729cafb6f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:56.334504 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-c5e9fb5d-a270-40e0-b014-084729cafb6f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:56.342240 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c5e9fb5d-a270-40e0-b014-084729cafb6f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:56.342685 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c5e9fb5d-a270-40e0-b014-084729cafb6f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:56.343491 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c5e9fb5d-a270-40e0-b014-084729cafb6f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:56.343931 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c5e9fb5d-a270-40e0-b014-084729cafb6f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:56.481904 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c5e9fb5d-a270-40e0-b014-084729cafb6f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:56.489432 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-c5e9fb5d-a270-40e0-b014-084729cafb6f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1677 microversion: 2.1 time: 0.159610 Jun 17 09:01:56.490002 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 558/1112] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:56 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:01:57.506681 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d2f4b95d-fd85-4fe5-8fce-7ce137c8483a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:57.507285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-d2f4b95d-fd85-4fe5-8fce-7ce137c8483a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:57.514707 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d2f4b95d-fd85-4fe5-8fce-7ce137c8483a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:57.515150 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d2f4b95d-fd85-4fe5-8fce-7ce137c8483a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:57.515947 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d2f4b95d-fd85-4fe5-8fce-7ce137c8483a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:57.516387 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d2f4b95d-fd85-4fe5-8fce-7ce137c8483a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:57.645786 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-d2f4b95d-fd85-4fe5-8fce-7ce137c8483a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:57.654050 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-d2f4b95d-fd85-4fe5-8fce-7ce137c8483a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1677 microversion: 2.1 time: 0.151239 Jun 17 09:01:57.654614 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 555/1113] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:57 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:01:58.672038 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-3e6e9685-62df-44eb-91e3-621abb5e7eda tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:58.672604 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-3e6e9685-62df-44eb-91e3-621abb5e7eda tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:58.679061 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3e6e9685-62df-44eb-91e3-621abb5e7eda tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:58.679810 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3e6e9685-62df-44eb-91e3-621abb5e7eda tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:58.680568 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3e6e9685-62df-44eb-91e3-621abb5e7eda tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:58.681002 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3e6e9685-62df-44eb-91e3-621abb5e7eda tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:58.814303 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-3e6e9685-62df-44eb-91e3-621abb5e7eda tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:58.823920 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-3e6e9685-62df-44eb-91e3-621abb5e7eda tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1677 microversion: 2.1 time: 0.155382 Jun 17 09:01:58.824880 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 559/1114] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:58 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 09:01:59.859162 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-6700ed9d-9d9d-4439-a5f5-34f42c1d7b1a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:01:59.859162 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-6700ed9d-9d9d-4439-a5f5-34f42c1d7b1a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:01:59.859162 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6700ed9d-9d9d-4439-a5f5-34f42c1d7b1a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:59.859162 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6700ed9d-9d9d-4439-a5f5-34f42c1d7b1a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:59.860009 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6700ed9d-9d9d-4439-a5f5-34f42c1d7b1a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:01:59.860009 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6700ed9d-9d9d-4439-a5f5-34f42c1d7b1a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:01:59.982362 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-6700ed9d-9d9d-4439-a5f5-34f42c1d7b1a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:01:59.989788 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-6700ed9d-9d9d-4439-a5f5-34f42c1d7b1a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1677 microversion: 2.1 time: 0.152450 Jun 17 09:01:59.990350 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 556/1115] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:01:59 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:02:01.007473 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-aa31539a-f5cb-4b7d-b118-041e73451a8c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:02:01.008299 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-aa31539a-f5cb-4b7d-b118-041e73451a8c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:02:01.014809 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-aa31539a-f5cb-4b7d-b118-041e73451a8c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:01.015262 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-aa31539a-f5cb-4b7d-b118-041e73451a8c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:01.016092 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-aa31539a-f5cb-4b7d-b118-041e73451a8c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:01.016532 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-aa31539a-f5cb-4b7d-b118-041e73451a8c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:01.151647 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-aa31539a-f5cb-4b7d-b118-041e73451a8c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:02:01.159557 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-aa31539a-f5cb-4b7d-b118-041e73451a8c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1654 microversion: 2.1 time: 0.156023 Jun 17 09:02:01.160137 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 560/1116] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:02:01 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1654 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:02:01.176205 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-8ce19e02-d832-46b0-8b7c-6a35cc910ad5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:02:01.183687 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8ce19e02-d832-46b0-8b7c-6a35cc910ad5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:01.184183 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8ce19e02-d832-46b0-8b7c-6a35cc910ad5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:01.206592 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-8ce19e02-d832-46b0-8b7c-6a35cc910ad5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Going to try to start instance {{(pid=129875) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 17 09:02:01.489830 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-8ce19e02-d832-46b0-8b7c-6a35cc910ad5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "POST /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475/action" status: 202 len: 0 microversion: 2.1 time: 0.317466 Jun 17 09:02:01.490678 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 557/1117] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jun 17 09:02:01 2022] POST /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 09:02:01.499559 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-54d88272-7119-4aef-9677-80e722f5cc29 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:02:01.505157 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-54d88272-7119-4aef-9677-80e722f5cc29 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:02:01.506811 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-54d88272-7119-4aef-9677-80e722f5cc29 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:01.507557 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-54d88272-7119-4aef-9677-80e722f5cc29 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:01.508254 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-54d88272-7119-4aef-9677-80e722f5cc29 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:01.508695 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-54d88272-7119-4aef-9677-80e722f5cc29 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:01.643379 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-54d88272-7119-4aef-9677-80e722f5cc29 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:02:01.653481 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-54d88272-7119-4aef-9677-80e722f5cc29 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1663 microversion: 2.1 time: 0.158684 Jun 17 09:02:01.654268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 561/1118] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:02:01 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 09:02:02.670979 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-9e98592f-283b-4b61-a4cb-fd5f1a896279 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:02:02.671737 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-9e98592f-283b-4b61-a4cb-fd5f1a896279 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:02:02.677950 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9e98592f-283b-4b61-a4cb-fd5f1a896279 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:02.678401 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9e98592f-283b-4b61-a4cb-fd5f1a896279 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:02.679165 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9e98592f-283b-4b61-a4cb-fd5f1a896279 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:02.679886 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9e98592f-283b-4b61-a4cb-fd5f1a896279 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:02.808588 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-9e98592f-283b-4b61-a4cb-fd5f1a896279 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:02:02.816143 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-9e98592f-283b-4b61-a4cb-fd5f1a896279 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1663 microversion: 2.1 time: 0.149856 Jun 17 09:02:02.816728 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 558/1119] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:02:02 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1663 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:02:03.834529 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-4f8eb22c-e402-409f-9a61-bd53370b6553 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:02:03.835198 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-4f8eb22c-e402-409f-9a61-bd53370b6553 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:02:03.842826 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4f8eb22c-e402-409f-9a61-bd53370b6553 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:03.843283 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4f8eb22c-e402-409f-9a61-bd53370b6553 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:03.844105 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4f8eb22c-e402-409f-9a61-bd53370b6553 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:03.844546 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-4f8eb22c-e402-409f-9a61-bd53370b6553 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:03.977441 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-4f8eb22c-e402-409f-9a61-bd53370b6553 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:02:03.985262 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-4f8eb22c-e402-409f-9a61-bd53370b6553 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1667 microversion: 2.1 time: 0.154723 Jun 17 09:02:03.985837 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 562/1120] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:02:03 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1667 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:02:36.133301 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-713ab8bb-5847-44cd-ba06-b07c84968c90 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:02:36.140065 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-713ab8bb-5847-44cd-ba06-b07c84968c90 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:02:36.140065 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=16 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:02:36.140065 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:02:36.142952 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-713ab8bb-5847-44cd-ba06-b07c84968c90 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:36.143489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-713ab8bb-5847-44cd-ba06-b07c84968c90 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:36.145082 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-713ab8bb-5847-44cd-ba06-b07c84968c90 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:36.145082 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-713ab8bb-5847-44cd-ba06-b07c84968c90 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:36.179360 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-713ab8bb-5847-44cd-ba06-b07c84968c90 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049867 Jun 17 09:02:36.180010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 559/1121] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 09:02:36 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 09:02:36.240640 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-b6922f32-a8f4-4b06-b54e-8abdb8071954 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:02:36.241207 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-b6922f32-a8f4-4b06-b54e-8abdb8071954 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:02:36.243546 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_api:SELECT=16 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:02:36.244209 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:02:36.249598 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b6922f32-a8f4-4b06-b54e-8abdb8071954 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:36.250156 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b6922f32-a8f4-4b06-b54e-8abdb8071954 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:36.255478 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b6922f32-a8f4-4b06-b54e-8abdb8071954 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:36.255478 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b6922f32-a8f4-4b06-b54e-8abdb8071954 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:36.277392 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-b6922f32-a8f4-4b06-b54e-8abdb8071954 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Going to try to terminate instance {{(pid=129876) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 09:02:36.644450 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-b6922f32-a8f4-4b06-b54e-8abdb8071954 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 204 len: 0 microversion: 2.1 time: 0.407850 Jun 17 09:02:36.644969 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 563/1122] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 09:02:36 2022] DELETE /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 09:02:36.653183 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-cfdb44f2-c3cb-4472-a412-96e23a8cdc33 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:02:36.654182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-cfdb44f2-c3cb-4472-a412-96e23a8cdc33 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:02:36.661713 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-cfdb44f2-c3cb-4472-a412-96e23a8cdc33 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:36.662172 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-cfdb44f2-c3cb-4472-a412-96e23a8cdc33 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:36.662992 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-cfdb44f2-c3cb-4472-a412-96e23a8cdc33 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:36.663463 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-cfdb44f2-c3cb-4472-a412-96e23a8cdc33 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:36.796423 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-cfdb44f2-c3cb-4472-a412-96e23a8cdc33 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:02:36.804966 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-cfdb44f2-c3cb-4472-a412-96e23a8cdc33 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1673 microversion: 2.1 time: 0.155740 Jun 17 09:02:36.805537 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 560/1123] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:02:36 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:02:37.822820 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-58c77cad-0bdb-48eb-9332-078303d9ec9c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:02:37.823567 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-58c77cad-0bdb-48eb-9332-078303d9ec9c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:02:37.830475 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-58c77cad-0bdb-48eb-9332-078303d9ec9c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:37.831636 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-58c77cad-0bdb-48eb-9332-078303d9ec9c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:37.832418 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-58c77cad-0bdb-48eb-9332-078303d9ec9c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:37.832863 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-58c77cad-0bdb-48eb-9332-078303d9ec9c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:37.965280 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-58c77cad-0bdb-48eb-9332-078303d9ec9c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:02:37.972759 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-58c77cad-0bdb-48eb-9332-078303d9ec9c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1673 microversion: 2.1 time: 0.154181 Jun 17 09:02:37.973324 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 564/1124] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:02:37 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:02:38.988922 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-5c426341-3767-4ac0-a410-a4ccff40d178 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:02:38.989588 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-5c426341-3767-4ac0-a410-a4ccff40d178 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:02:38.996905 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5c426341-3767-4ac0-a410-a4ccff40d178 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:38.997357 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5c426341-3767-4ac0-a410-a4ccff40d178 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:38.998130 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5c426341-3767-4ac0-a410-a4ccff40d178 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:38.998567 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-5c426341-3767-4ac0-a410-a4ccff40d178 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:39.135049 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-5c426341-3767-4ac0-a410-a4ccff40d178 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:02:39.143903 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-5c426341-3767-4ac0-a410-a4ccff40d178 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1673 microversion: 2.1 time: 0.158158 Jun 17 09:02:39.144601 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 561/1125] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:02:38 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:02:39.402468 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-e0b9fd4f-4f76-4d0f-ae54-0bdf7a7c0796 req-d819696b-e240-4f1b-b108-5351bb6b061e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29e3483-56d1-40fb-a15f-5a57da6e5475", "name": "network-vif-deleted", "tag": "7443cff9-145e-466b-bab6-4dd50a0da0ac"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:02:39.411380 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-e0b9fd4f-4f76-4d0f-ae54-0bdf7a7c0796 req-d819696b-e240-4f1b-b108-5351bb6b061e service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:39.412069 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-e0b9fd4f-4f76-4d0f-ae54-0bdf7a7c0796 req-d819696b-e240-4f1b-b108-5351bb6b061e service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:39.427170 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-e0b9fd4f-4f76-4d0f-ae54-0bdf7a7c0796 req-d819696b-e240-4f1b-b108-5351bb6b061e service nova] Creating event network-vif-deleted:7443cff9-145e-466b-bab6-4dd50a0da0ac for instance d29e3483-56d1-40fb-a15f-5a57da6e5475 on hv-cinder-79760 Jun 17 09:02:39.432866 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-e0b9fd4f-4f76-4d0f-ae54-0bdf7a7c0796 req-d819696b-e240-4f1b-b108-5351bb6b061e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034930 Jun 17 09:02:39.433704 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 565/1126] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 09:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:02:40.165217 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-8c5caac5-235b-4693-a400-8f4d905ed3ba tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:02:40.165217 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-8c5caac5-235b-4693-a400-8f4d905ed3ba tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:02:40.168975 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8c5caac5-235b-4693-a400-8f4d905ed3ba tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:40.169444 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8c5caac5-235b-4693-a400-8f4d905ed3ba tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:40.170223 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8c5caac5-235b-4693-a400-8f4d905ed3ba tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:40.170657 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8c5caac5-235b-4693-a400-8f4d905ed3ba tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:40.206589 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8c5caac5-235b-4693-a400-8f4d905ed3ba tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:40.207138 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8c5caac5-235b-4693-a400-8f4d905ed3ba tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:40.207623 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-8c5caac5-235b-4693-a400-8f4d905ed3ba tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lazy-loading 'fault' on Instance uuid d29e3483-56d1-40fb-a15f-5a57da6e5475 {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 09:02:40.253911 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-8c5caac5-235b-4693-a400-8f4d905ed3ba tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:02:40.261607 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-8c5caac5-235b-4693-a400-8f4d905ed3ba tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 200 len: 1327 microversion: 2.1 time: 0.104182 Jun 17 09:02:40.262185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 562/1127] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:02:40 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 09:02:41.283341 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-7ff1495d-958d-47c2-9453-bf36e3ca1fb5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:02:41.284760 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-7ff1495d-958d-47c2-9453-bf36e3ca1fb5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:02:41.291689 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7ff1495d-958d-47c2-9453-bf36e3ca1fb5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:41.292139 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7ff1495d-958d-47c2-9453-bf36e3ca1fb5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:41.292903 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7ff1495d-958d-47c2-9453-bf36e3ca1fb5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:41.293334 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-7ff1495d-958d-47c2-9453-bf36e3ca1fb5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:41.307657 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-7ff1495d-958d-47c2-9453-bf36e3ca1fb5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] HTTP exception thrown: Instance d29e3483-56d1-40fb-a15f-5a57da6e5475 could not be found. Jun 17 09:02:41.309282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-7ff1495d-958d-47c2-9453-bf36e3ca1fb5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Request method failure captured: Jun 17 09:02:41.309282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 HTTP/1.1 Jun 17 09:02:41.309282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 09:02:41.309282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 09:02:41.309282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 09:02:41.309282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 09:02:41.309282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 09:02:41.309282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 09:02:41.309282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 09:02:41.309282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 09:02:41.309282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirEKD1DEWRZVRUveV5UEZzucfNrYDHwPR19E9HSeuTAJvYtv-tRMSey7zis4DE7QWyLY9sP3u8vZ9YZaCir2zfM9yx-3yfXT3ZzT7BhAc5PMkJx1scolSO_aoqUUnCeRoZHDslCqc1M2LaLnuzVzGAXFKThgGs8lzrOZKQDGy1Ael5Rk Jun 17 09:02:41.309282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 09:02:41.309282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 09:02:41.309282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 09:02:41.309282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 09:02:41.309282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 09:02:41.309282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 09:02:41.309282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: f0964a125c554efe858f7695016de8db Jun 17 09:02:41.309282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-AttachVolumeTestJSON-1223322254 Jun 17 09:02:41.309282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 09:02:41.309282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 09:02:41.310939 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f0964a125c554efe858f7695016de8db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f0964a125c554efe858f7695016de8db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f0964a125c554efe858f7695016de8db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f0964a125c554efe858f7695016de8db"}]}] Jun 17 09:02:41.310939 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-AttachVolumeTestJSON-1223322254 Jun 17 09:02:41.310939 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: f0964a125c554efe858f7695016de8db Jun 17 09:02:41.310939 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1223322254 Jun 17 09:02:41.310939 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-AttachVolumeTestJSON-1223322254-project Jun 17 09:02:41.310939 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 09:02:41.310939 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 09:02:41.310939 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: 449850e1f8d144eb8b330a764882a099 Jun 17 09:02:41.310939 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-AttachVolumeTestJSON-1223322254-project Jun 17 09:02:41.310939 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 09:02:41.310939 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Instance d29e3483-56d1-40fb-a15f-5a57da6e5475 could not be found. Jun 17 09:02:41.310939 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'id': 'd29e3483-56d1-40fb-a15f-5a57da6e5475'} Jun 17 09:02:41.311956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 09:02:41.311956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:02:41.311956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 09:02:41.311956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 09:02:41.311956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 09:02:41.311956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 09:02:41.311956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 09:02:41.311956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 09:02:41.311956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 09:02:41.311956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 09:02:41.311956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d29e3483-56d1-40fb-a15f-5a57da6e5475 could not be found. Jun 17 09:02:41.311956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:02:41.311956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:02:41.311956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:02:41.311956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:02:41.311956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:02:41.311956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:02:41.311956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 09:02:41.311956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 09:02:41.311956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 09:02:41.313596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 09:02:41.313596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 09:02:41.313596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 09:02:41.313596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 09:02:41.313596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 09:02:41.313596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 09:02:41.313596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 09:02:41.313596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d29e3483-56d1-40fb-a15f-5a57da6e5475 could not be found. Jun 17 09:02:41.313596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:02:41.313596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:02:41.313596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:02:41.313596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:02:41.313596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:02:41.313596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:02:41.313596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 09:02:41.313596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 09:02:41.313596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d29e3483-56d1-40fb-a15f-5a57da6e5475 could not be found. Jun 17 09:02:41.313596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:02:41.315163 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-7ff1495d-958d-47c2-9453-bf36e3ca1fb5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Returning 404 to user: Instance d29e3483-56d1-40fb-a15f-5a57da6e5475 could not be found. {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 09:02:41.315163 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-7ff1495d-958d-47c2-9453-bf36e3ca1fb5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 404 len: 111 microversion: 2.1 time: 0.031848 Jun 17 09:02:41.315163 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 566/1128] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:02:41 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 09:02:41.319489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-2830e9aa-417f-488a-9a3e-b65b1e7f7bfb tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '.version_select at 0x7fbc404a2670>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:02:41.462531 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-2830e9aa-417f-488a-9a3e-b65b1e7f7bfb tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094708853" status: 202 len: 0 microversion: 2.1 time: 0.146811 Jun 17 09:02:41.463120 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 563/1129] 10.222.0.78 () {58 vars in 1220 bytes} [Fri Jun 17 09:02:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094708853 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 09:02:42.247906 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-18509c54-0b07-45ac-b5f0-46608985a91b tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Action: 'create', calling method: .version_select at 0x7fbc33c9d4c0>, body: {"keypair": {"name": "tempest-keypair-1506951956", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhZncGHPC7hvghSkouDYO4Fy9cXRW1PD+jq0UorYt45za2UY7JeYz16vP0YArc1SgDEHwh0FcXg5hIXxTk5+Ixiip9IgSM5vjlrvNtuuk9rU6Qfuk2WXvBjci4ejykC2A=="}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:02:42.262423 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-18509c54-0b07-45ac-b5f0-46608985a91b tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Getting quotas for project f0964a125c554efe858f7695016de8db. Resources: {'key_pairs'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 09:02:42.266492 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-18509c54-0b07-45ac-b5f0-46608985a91b tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Getting quotas for user 449850e1f8d144eb8b330a764882a099 and project f0964a125c554efe858f7695016de8db. Resources: {'key_pairs'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 09:02:42.338687 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-18509c54-0b07-45ac-b5f0-46608985a91b tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.094707 Jun 17 09:02:42.339381 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 567/1130] 10.222.0.78 () {60 vars in 1158 bytes} [Fri Jun 17 09:02:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:02:44.810034 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-4ce4fd93-ea2f-4d33-abab-b246663ffb67 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-250713933", "imageRef": "978084c7-ed2c-4e42-ac8b-f5d19c4001fe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7268d72-a199-4405-a1f3-cc49733ddcf9"}], "security_groups": [{"name": "tempest-securitygroup--1773378368"}], "key_name": "tempest-keypair-1506951956", "user_data": "}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:02:44.911672 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.network.neutron [None req-4ce4fd93-ea2f-4d33-abab-b246663ffb67 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] validate_networks() for [('f7268d72-a199-4405-a1f3-cc49733ddcf9', None, None, None, None, None)] {{(pid=129875) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 09:02:45.294101 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-4ce4fd93-ea2f-4d33-abab-b246663ffb67 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Flavor limits 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 09:02:45.294543 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-4ce4fd93-ea2f-4d33-abab-b246663ffb67 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Image limits 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 09:02:45.295020 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-4ce4fd93-ea2f-4d33-abab-b246663ffb67 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Flavor pref 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 09:02:45.295462 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-4ce4fd93-ea2f-4d33-abab-b246663ffb67 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Image pref 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 09:02:45.295875 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-4ce4fd93-ea2f-4d33-abab-b246663ffb67 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 09:02:45.305276 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4ce4fd93-ea2f-4d33-abab-b246663ffb67 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:45.305724 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4ce4fd93-ea2f-4d33-abab-b246663ffb67 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:45.306527 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4ce4fd93-ea2f-4d33-abab-b246663ffb67 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:45.306962 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-4ce4fd93-ea2f-4d33-abab-b246663ffb67 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:45.323993 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-4ce4fd93-ea2f-4d33-abab-b246663ffb67 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Getting quotas for project f0964a125c554efe858f7695016de8db. Resources: {'ram', 'cores', 'instances'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 09:02:45.327901 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-4ce4fd93-ea2f-4d33-abab-b246663ffb67 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Getting quotas for user 449850e1f8d144eb8b330a764882a099 and project f0964a125c554efe858f7695016de8db. Resources: {'ram', 'cores', 'instances'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 09:02:45.339977 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-4ce4fd93-ea2f-4d33-abab-b246663ffb67 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Going to run 1 instances... {{(pid=129875) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 09:02:45.342312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-4ce4fd93-ea2f-4d33-abab-b246663ffb67 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='978084c7-ed2c-4e42-ac8b-f5d19c4001fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 09:02:45.466155 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-4ce4fd93-ea2f-4d33-abab-b246663ffb67 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.660390 Jun 17 09:02:45.466861 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 564/1131] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jun 17 09:02:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 09:02:45.477250 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-b98ba1e9-839d-4926-8bf3-7c57e2d40bb1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:02:45.479662 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-b98ba1e9-839d-4926-8bf3-7c57e2d40bb1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:02:45.534635 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-b98ba1e9-839d-4926-8bf3-7c57e2d40bb1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:02:45.541543 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-b98ba1e9-839d-4926-8bf3-7c57e2d40bb1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2" status: 200 len: 1237 microversion: 2.1 time: 0.068600 Jun 17 09:02:45.542168 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 568/1132] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:02:45 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2 => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 09:02:46.559843 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-c23361ed-01c6-43a0-b63e-960095d91553 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:02:46.560460 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-c23361ed-01c6-43a0-b63e-960095d91553 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:02:46.568801 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c23361ed-01c6-43a0-b63e-960095d91553 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:46.569252 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c23361ed-01c6-43a0-b63e-960095d91553 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:46.570027 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c23361ed-01c6-43a0-b63e-960095d91553 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:46.570464 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c23361ed-01c6-43a0-b63e-960095d91553 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:46.634081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-c23361ed-01c6-43a0-b63e-960095d91553 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:02:46.641461 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-c23361ed-01c6-43a0-b63e-960095d91553 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2" status: 200 len: 1241 microversion: 2.1 time: 0.085804 Jun 17 09:02:46.642031 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 565/1133] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:02:46 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:02:47.662189 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-2a8aa00e-46b2-45b0-a994-4f2647536487 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:02:47.662890 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-2a8aa00e-46b2-45b0-a994-4f2647536487 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:02:47.669855 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2a8aa00e-46b2-45b0-a994-4f2647536487 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:47.670322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2a8aa00e-46b2-45b0-a994-4f2647536487 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:47.671105 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2a8aa00e-46b2-45b0-a994-4f2647536487 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:47.671606 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2a8aa00e-46b2-45b0-a994-4f2647536487 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:47.735307 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-2a8aa00e-46b2-45b0-a994-4f2647536487 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:02:47.743857 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-2a8aa00e-46b2-45b0-a994-4f2647536487 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2" status: 200 len: 1297 microversion: 2.1 time: 0.088380 Jun 17 09:02:47.744447 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 569/1134] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:02:47 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2 => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:02:48.762653 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-ba4bfd52-d6a5-4f97-8f4d-6b706961dec1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:02:48.763289 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-ba4bfd52-d6a5-4f97-8f4d-6b706961dec1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:02:48.771062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ba4bfd52-d6a5-4f97-8f4d-6b706961dec1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:48.771543 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ba4bfd52-d6a5-4f97-8f4d-6b706961dec1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:48.772305 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ba4bfd52-d6a5-4f97-8f4d-6b706961dec1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:48.772833 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ba4bfd52-d6a5-4f97-8f4d-6b706961dec1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:48.904157 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-ba4bfd52-d6a5-4f97-8f4d-6b706961dec1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:02:48.912160 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-ba4bfd52-d6a5-4f97-8f4d-6b706961dec1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2" status: 200 len: 1363 microversion: 2.1 time: 0.153354 Jun 17 09:02:48.912758 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 566/1135] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:02:48 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:02:49.471178 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-787f78bd-e075-4c5f-ad78-c9acba5491f4 req-3c5d25ae-e2fd-4b51-9a08-673da4fcd1a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "290903b6-0ce5-4bf4-a25e-0f15abc014c2", "tag": "2c23f345-ee57-4a33-b2ff-9bafffa96644"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:02:49.485835 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-787f78bd-e075-4c5f-ad78-c9acba5491f4 req-3c5d25ae-e2fd-4b51-9a08-673da4fcd1a1 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:49.487022 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-787f78bd-e075-4c5f-ad78-c9acba5491f4 req-3c5d25ae-e2fd-4b51-9a08-673da4fcd1a1 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:49.499928 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-787f78bd-e075-4c5f-ad78-c9acba5491f4 req-3c5d25ae-e2fd-4b51-9a08-673da4fcd1a1 service nova] Creating event network-changed:2c23f345-ee57-4a33-b2ff-9bafffa96644 for instance 290903b6-0ce5-4bf4-a25e-0f15abc014c2 on hv-cinder-79760 Jun 17 09:02:49.505042 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-787f78bd-e075-4c5f-ad78-c9acba5491f4 req-3c5d25ae-e2fd-4b51-9a08-673da4fcd1a1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037648 Jun 17 09:02:49.505637 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 570/1136] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 09:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:02:49.929564 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a59ee84a-52bc-4d45-ac8c-10d0549d2cfc tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:02:49.930302 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-a59ee84a-52bc-4d45-ac8c-10d0549d2cfc tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:02:49.936811 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a59ee84a-52bc-4d45-ac8c-10d0549d2cfc tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:49.937264 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a59ee84a-52bc-4d45-ac8c-10d0549d2cfc tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:49.938019 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a59ee84a-52bc-4d45-ac8c-10d0549d2cfc tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:49.938500 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a59ee84a-52bc-4d45-ac8c-10d0549d2cfc tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:50.079032 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a59ee84a-52bc-4d45-ac8c-10d0549d2cfc tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:02:50.086558 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-a59ee84a-52bc-4d45-ac8c-10d0549d2cfc tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2" status: 200 len: 1363 microversion: 2.1 time: 0.161158 Jun 17 09:02:50.087135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 567/1137] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:02:49 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:02:51.104632 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-786ce7ae-5abd-4d6d-9752-560a1cee7713 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:02:51.105329 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-786ce7ae-5abd-4d6d-9752-560a1cee7713 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:02:51.111605 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-786ce7ae-5abd-4d6d-9752-560a1cee7713 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:51.112060 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-786ce7ae-5abd-4d6d-9752-560a1cee7713 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:51.113352 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-786ce7ae-5abd-4d6d-9752-560a1cee7713 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:51.113875 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-786ce7ae-5abd-4d6d-9752-560a1cee7713 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:51.244454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-786ce7ae-5abd-4d6d-9752-560a1cee7713 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:02:51.252198 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-786ce7ae-5abd-4d6d-9752-560a1cee7713 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2" status: 200 len: 1363 microversion: 2.1 time: 0.152301 Jun 17 09:02:51.252977 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 571/1138] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:02:51 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:02:52.270071 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-e410e285-1878-43bc-b370-dc77d9ba14dc tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:02:52.270691 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-e410e285-1878-43bc-b370-dc77d9ba14dc tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:02:52.277489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e410e285-1878-43bc-b370-dc77d9ba14dc tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:52.277992 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e410e285-1878-43bc-b370-dc77d9ba14dc tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:52.278771 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e410e285-1878-43bc-b370-dc77d9ba14dc tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:52.279215 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e410e285-1878-43bc-b370-dc77d9ba14dc tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:52.415426 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-e410e285-1878-43bc-b370-dc77d9ba14dc tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:02:52.422999 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-e410e285-1878-43bc-b370-dc77d9ba14dc tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2" status: 200 len: 1363 microversion: 2.1 time: 0.157693 Jun 17 09:02:52.433247 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 568/1139] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:02:52 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:02:53.441733 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-ddc15e42-b59b-4bac-a798-c5f86c4c25c8 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:02:53.442355 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-ddc15e42-b59b-4bac-a798-c5f86c4c25c8 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:02:53.449005 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ddc15e42-b59b-4bac-a798-c5f86c4c25c8 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:53.449464 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ddc15e42-b59b-4bac-a798-c5f86c4c25c8 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:53.450310 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ddc15e42-b59b-4bac-a798-c5f86c4c25c8 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:53.450667 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-ddc15e42-b59b-4bac-a798-c5f86c4c25c8 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:53.578730 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-ddc15e42-b59b-4bac-a798-c5f86c4c25c8 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:02:53.586256 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-ddc15e42-b59b-4bac-a798-c5f86c4c25c8 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2" status: 200 len: 1363 microversion: 2.1 time: 0.149265 Jun 17 09:02:53.586889 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 572/1140] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:02:53 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:02:54.446900 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-1e4ea19d-d811-46e7-8f76-29539c507845 req-297a56cb-01f7-4664-8f13-de9e48eaf57e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "290903b6-0ce5-4bf4-a25e-0f15abc014c2", "name": "network-vif-plugged", "status": "completed", "tag": "2c23f345-ee57-4a33-b2ff-9bafffa96644"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:02:54.455160 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-1e4ea19d-d811-46e7-8f76-29539c507845 req-297a56cb-01f7-4664-8f13-de9e48eaf57e service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:54.456800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-1e4ea19d-d811-46e7-8f76-29539c507845 req-297a56cb-01f7-4664-8f13-de9e48eaf57e service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:54.467336 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-1e4ea19d-d811-46e7-8f76-29539c507845 req-297a56cb-01f7-4664-8f13-de9e48eaf57e service nova] Creating event network-vif-plugged:2c23f345-ee57-4a33-b2ff-9bafffa96644 for instance 290903b6-0ce5-4bf4-a25e-0f15abc014c2 on hv-cinder-79760 Jun 17 09:02:54.472285 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-1e4ea19d-d811-46e7-8f76-29539c507845 req-297a56cb-01f7-4664-8f13-de9e48eaf57e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088582 Jun 17 09:02:54.472917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 569/1141] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 09:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:02:54.602848 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a40aad69-1047-49ff-88ff-ebdcfe6f8667 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:02:54.603506 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a40aad69-1047-49ff-88ff-ebdcfe6f8667 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:02:54.610217 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a40aad69-1047-49ff-88ff-ebdcfe6f8667 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:54.610615 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a40aad69-1047-49ff-88ff-ebdcfe6f8667 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:54.611415 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a40aad69-1047-49ff-88ff-ebdcfe6f8667 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:54.611883 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a40aad69-1047-49ff-88ff-ebdcfe6f8667 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:54.745728 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a40aad69-1047-49ff-88ff-ebdcfe6f8667 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:02:54.753768 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a40aad69-1047-49ff-88ff-ebdcfe6f8667 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2" status: 200 len: 1363 microversion: 2.1 time: 0.154190 Jun 17 09:02:54.754416 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 573/1142] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:02:54 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:02:55.767251 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=2 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:02:55.768068 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=6 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:02:55.773358 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0f8ee2d5-e810-4b78-ace9-b7e816cf3b3a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:02:55.774139 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0f8ee2d5-e810-4b78-ace9-b7e816cf3b3a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:02:55.780317 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0f8ee2d5-e810-4b78-ace9-b7e816cf3b3a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:55.780872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0f8ee2d5-e810-4b78-ace9-b7e816cf3b3a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:55.781627 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0f8ee2d5-e810-4b78-ace9-b7e816cf3b3a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:55.782072 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0f8ee2d5-e810-4b78-ace9-b7e816cf3b3a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:55.917740 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0f8ee2d5-e810-4b78-ace9-b7e816cf3b3a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:02:55.925442 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0f8ee2d5-e810-4b78-ace9-b7e816cf3b3a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2" status: 200 len: 1363 microversion: 2.1 time: 0.159050 Jun 17 09:02:55.926260 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 570/1143] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:02:55 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:02:56.942507 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-27cce5ff-69a0-489f-af9a-3f4a3efe0848 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:02:56.943118 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-27cce5ff-69a0-489f-af9a-3f4a3efe0848 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:02:56.945102 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=6 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:02:56.950630 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-27cce5ff-69a0-489f-af9a-3f4a3efe0848 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:56.951091 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-27cce5ff-69a0-489f-af9a-3f4a3efe0848 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:56.952041 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-27cce5ff-69a0-489f-af9a-3f4a3efe0848 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:56.952547 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-27cce5ff-69a0-489f-af9a-3f4a3efe0848 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:57.084398 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-27cce5ff-69a0-489f-af9a-3f4a3efe0848 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:02:57.091809 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-27cce5ff-69a0-489f-af9a-3f4a3efe0848 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2" status: 200 len: 1549 microversion: 2.1 time: 0.153374 Jun 17 09:02:57.092373 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 574/1144] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:02:56 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:02:57.108502 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-8a41d70b-19d9-4778-9745-fb9dd1b5e792 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:02:57.109032 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-8a41d70b-19d9-4778-9745-fb9dd1b5e792 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:02:57.115530 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8a41d70b-19d9-4778-9745-fb9dd1b5e792 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:57.115985 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8a41d70b-19d9-4778-9745-fb9dd1b5e792 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:57.116755 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8a41d70b-19d9-4778-9745-fb9dd1b5e792 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:57.117195 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-8a41d70b-19d9-4778-9745-fb9dd1b5e792 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:57.199418 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-8a41d70b-19d9-4778-9745-fb9dd1b5e792 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094729 Jun 17 09:02:57.200030 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 571/1145] 10.222.0.78 () {58 vars in 1274 bytes} [Fri Jun 17 09:02:57 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:02:58.268745 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-701bf975-ab53-4832-b226-2e110ec48279 req-9b8e97ec-082c-49ef-87ec-b88fb54a89cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "290903b6-0ce5-4bf4-a25e-0f15abc014c2", "tag": "2c23f345-ee57-4a33-b2ff-9bafffa96644"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:02:58.277521 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-701bf975-ab53-4832-b226-2e110ec48279 req-9b8e97ec-082c-49ef-87ec-b88fb54a89cc service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:02:58.280971 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-701bf975-ab53-4832-b226-2e110ec48279 req-9b8e97ec-082c-49ef-87ec-b88fb54a89cc service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:02:58.290310 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-701bf975-ab53-4832-b226-2e110ec48279 req-9b8e97ec-082c-49ef-87ec-b88fb54a89cc service nova] Creating event network-changed:2c23f345-ee57-4a33-b2ff-9bafffa96644 for instance 290903b6-0ce5-4bf4-a25e-0f15abc014c2 on hv-cinder-79760 Jun 17 09:02:58.295472 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-701bf975-ab53-4832-b226-2e110ec48279 req-9b8e97ec-082c-49ef-87ec-b88fb54a89cc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095690 Jun 17 09:02:58.296070 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 575/1146] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 09:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:03:06.805239 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-e2373599-9d64-48ea-b313-06f39f8339f5 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-155982886", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-899283893", "security_groups": [{"name": "tempest-secgroup-smoke-926804049"}], "block_device_mapping_v2": [{"uuid": "3b2e277d-f2fd-47aa-bbd9-4fd915a26a8c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "131209d2-1a19-4f69-ac13-17a3bc0e6ba1"}]}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:03:06.813144 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:03:06.921074 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.network.neutron [None req-e2373599-9d64-48ea-b313-06f39f8339f5 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] validate_networks() for [('131209d2-1a19-4f69-ac13-17a3bc0e6ba1', None, None, None, None, None)] {{(pid=129875) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 09:03:07.135409 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=64 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:03:07.580793 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-e2373599-9d64-48ea-b313-06f39f8339f5 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Flavor limits 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 09:03:07.581219 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-e2373599-9d64-48ea-b313-06f39f8339f5 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Image limits 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 09:03:07.581744 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-e2373599-9d64-48ea-b313-06f39f8339f5 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Flavor pref 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 09:03:07.582140 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-e2373599-9d64-48ea-b313-06f39f8339f5 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Image pref 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 09:03:07.582546 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-e2373599-9d64-48ea-b313-06f39f8339f5 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 09:03:07.591755 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e2373599-9d64-48ea-b313-06f39f8339f5 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:07.592222 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e2373599-9d64-48ea-b313-06f39f8339f5 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:07.593041 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e2373599-9d64-48ea-b313-06f39f8339f5 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:07.593479 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e2373599-9d64-48ea-b313-06f39f8339f5 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:07.610352 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-e2373599-9d64-48ea-b313-06f39f8339f5 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Getting quotas for project 4c3ecf1efb8748a0af09e501e2b9d81b. Resources: {'ram', 'cores', 'instances'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 09:03:07.617168 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-e2373599-9d64-48ea-b313-06f39f8339f5 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Getting quotas for user 61c06d41d371486c9856a17c5b2aee20 and project 4c3ecf1efb8748a0af09e501e2b9d81b. Resources: {'ram', 'cores', 'instances'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 09:03:07.672958 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-e2373599-9d64-48ea-b313-06f39f8339f5 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Going to run 1 instances... {{(pid=129875) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 09:03:07.675030 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-e2373599-9d64-48ea-b313-06f39f8339f5 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 30f34aae-76cf-4423-b9c0-db2ce701d138] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3b2e277d-f2fd-47aa-bbd9-4fd915a26a8c',volume_size=None,volume_type=None)] {{(pid=129875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 09:03:08.197402 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-e2373599-9d64-48ea-b313-06f39f8339f5 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.397820 Jun 17 09:03:08.198235 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 572/1147] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jun 17 09:03:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 1399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 09:03:08.208916 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e7e00e06-4db8-4827-995a-b9a99692af25 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:03:08.209602 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-e7e00e06-4db8-4827-995a-b9a99692af25 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 30f34aae-76cf-4423-b9c0-db2ce701d138] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:08.212304 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:03:08.267134 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e7e00e06-4db8-4827-995a-b9a99692af25 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:03:08.274359 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-e7e00e06-4db8-4827-995a-b9a99692af25 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138" status: 200 len: 1093 microversion: 2.1 time: 0.069646 Jun 17 09:03:08.275113 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 576/1148] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:03:08 2022] GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:03:09.291219 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-eeb5092d-5fe6-425a-86b9-0d59fb50eb41 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:03:09.291880 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-eeb5092d-5fe6-425a-86b9-0d59fb50eb41 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 30f34aae-76cf-4423-b9c0-db2ce701d138] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:09.298467 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eeb5092d-5fe6-425a-86b9-0d59fb50eb41 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:09.298894 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eeb5092d-5fe6-425a-86b9-0d59fb50eb41 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:09.299698 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eeb5092d-5fe6-425a-86b9-0d59fb50eb41 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:09.300186 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-eeb5092d-5fe6-425a-86b9-0d59fb50eb41 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:09.359606 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-eeb5092d-5fe6-425a-86b9-0d59fb50eb41 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:03:09.367084 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-eeb5092d-5fe6-425a-86b9-0d59fb50eb41 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138" status: 200 len: 1143 microversion: 2.1 time: 0.079814 Jun 17 09:03:09.367676 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 573/1149] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:03:09 2022] GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138 => generated 1143 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:03:10.386275 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-67aa7a78-e4a2-45a9-a96c-3ce2298c0f59 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:03:10.387168 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-67aa7a78-e4a2-45a9-a96c-3ce2298c0f59 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 30f34aae-76cf-4423-b9c0-db2ce701d138] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:10.389373 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:03:10.396130 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-67aa7a78-e4a2-45a9-a96c-3ce2298c0f59 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:10.396565 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-67aa7a78-e4a2-45a9-a96c-3ce2298c0f59 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:10.397345 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-67aa7a78-e4a2-45a9-a96c-3ce2298c0f59 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:10.397790 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-67aa7a78-e4a2-45a9-a96c-3ce2298c0f59 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:10.484971 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-67aa7a78-e4a2-45a9-a96c-3ce2298c0f59 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:03:10.496606 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-67aa7a78-e4a2-45a9-a96c-3ce2298c0f59 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138" status: 200 len: 1199 microversion: 2.1 time: 0.115834 Jun 17 09:03:10.498955 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 577/1150] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:03:10 2022] GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138 => generated 1199 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:03:11.514019 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-6c2f8328-705d-46ee-9708-3ad4234eef83 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:03:11.514627 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-6c2f8328-705d-46ee-9708-3ad4234eef83 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 30f34aae-76cf-4423-b9c0-db2ce701d138] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:11.521889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6c2f8328-705d-46ee-9708-3ad4234eef83 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:11.522337 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6c2f8328-705d-46ee-9708-3ad4234eef83 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:11.523753 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6c2f8328-705d-46ee-9708-3ad4234eef83 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:11.524256 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6c2f8328-705d-46ee-9708-3ad4234eef83 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:11.677566 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-6c2f8328-705d-46ee-9708-3ad4234eef83 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:03:11.685265 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-6c2f8328-705d-46ee-9708-3ad4234eef83 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138" status: 200 len: 1276 microversion: 2.1 time: 0.175153 Jun 17 09:03:11.685841 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 574/1151] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:03:11 2022] GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138 => generated 1276 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:03:12.354793 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-efa59269-6a06-4858-9662-15ca58af1485 req-0adedbc5-8a80-4504-8635-b4995ba0714e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30f34aae-76cf-4423-b9c0-db2ce701d138", "tag": "5841a5dd-f021-4da9-a952-f77917f1048b"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:03:12.363126 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-efa59269-6a06-4858-9662-15ca58af1485 req-0adedbc5-8a80-4504-8635-b4995ba0714e service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:12.363729 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-efa59269-6a06-4858-9662-15ca58af1485 req-0adedbc5-8a80-4504-8635-b4995ba0714e service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:12.374966 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-efa59269-6a06-4858-9662-15ca58af1485 req-0adedbc5-8a80-4504-8635-b4995ba0714e service nova] Creating event network-changed:5841a5dd-f021-4da9-a952-f77917f1048b for instance 30f34aae-76cf-4423-b9c0-db2ce701d138 on hv-cinder-79760 Jun 17 09:03:12.380956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-efa59269-6a06-4858-9662-15ca58af1485 req-0adedbc5-8a80-4504-8635-b4995ba0714e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091420 Jun 17 09:03:12.381589 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 578/1152] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 09:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:03:12.703242 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-10492e8c-bb9d-4de8-8f2a-55637990501f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:03:12.703915 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-10492e8c-bb9d-4de8-8f2a-55637990501f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 30f34aae-76cf-4423-b9c0-db2ce701d138] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:12.710594 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-10492e8c-bb9d-4de8-8f2a-55637990501f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:12.710982 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-10492e8c-bb9d-4de8-8f2a-55637990501f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:12.711790 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-10492e8c-bb9d-4de8-8f2a-55637990501f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:12.712234 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-10492e8c-bb9d-4de8-8f2a-55637990501f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:12.845941 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-10492e8c-bb9d-4de8-8f2a-55637990501f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:03:12.853646 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-10492e8c-bb9d-4de8-8f2a-55637990501f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138" status: 200 len: 1264 microversion: 2.1 time: 0.154323 Jun 17 09:03:12.854213 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 575/1153] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:03:12 2022] GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:03:13.872753 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-2df97e69-c23f-4ccf-857e-630b6e6c24e0 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:03:13.873454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-2df97e69-c23f-4ccf-857e-630b6e6c24e0 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 30f34aae-76cf-4423-b9c0-db2ce701d138] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:13.880876 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2df97e69-c23f-4ccf-857e-630b6e6c24e0 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:13.881327 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2df97e69-c23f-4ccf-857e-630b6e6c24e0 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:13.882089 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2df97e69-c23f-4ccf-857e-630b6e6c24e0 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:13.882530 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2df97e69-c23f-4ccf-857e-630b6e6c24e0 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:14.018462 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-2df97e69-c23f-4ccf-857e-630b6e6c24e0 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:03:14.026310 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-2df97e69-c23f-4ccf-857e-630b6e6c24e0 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138" status: 200 len: 1264 microversion: 2.1 time: 0.159065 Jun 17 09:03:14.026891 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 579/1154] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:03:13 2022] GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:03:15.044078 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a2afb436-a9b7-491e-964e-23f14ef10e15 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:03:15.044688 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-a2afb436-a9b7-491e-964e-23f14ef10e15 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 30f34aae-76cf-4423-b9c0-db2ce701d138] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:15.051968 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a2afb436-a9b7-491e-964e-23f14ef10e15 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:15.052414 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a2afb436-a9b7-491e-964e-23f14ef10e15 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:15.053182 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a2afb436-a9b7-491e-964e-23f14ef10e15 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:15.053874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a2afb436-a9b7-491e-964e-23f14ef10e15 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:15.182545 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-a2afb436-a9b7-491e-964e-23f14ef10e15 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:03:15.190267 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-a2afb436-a9b7-491e-964e-23f14ef10e15 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138" status: 200 len: 1264 microversion: 2.1 time: 0.150067 Jun 17 09:03:15.190828 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 576/1155] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:03:15 2022] GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 09:03:16.207534 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e0e1060d-79ef-4cb2-a0cc-388c1bfdf72b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:03:16.208180 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-e0e1060d-79ef-4cb2-a0cc-388c1bfdf72b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 30f34aae-76cf-4423-b9c0-db2ce701d138] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:16.214365 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e0e1060d-79ef-4cb2-a0cc-388c1bfdf72b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:16.214812 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e0e1060d-79ef-4cb2-a0cc-388c1bfdf72b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:16.215598 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e0e1060d-79ef-4cb2-a0cc-388c1bfdf72b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:16.216033 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e0e1060d-79ef-4cb2-a0cc-388c1bfdf72b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:16.350956 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e0e1060d-79ef-4cb2-a0cc-388c1bfdf72b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:03:16.358409 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-e0e1060d-79ef-4cb2-a0cc-388c1bfdf72b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138" status: 200 len: 1264 microversion: 2.1 time: 0.155349 Jun 17 09:03:16.363789 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 580/1156] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:03:16 2022] GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:03:17.374932 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-340b5d89-41e1-4f39-9199-9f50d7d08903 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:03:17.375591 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-340b5d89-41e1-4f39-9199-9f50d7d08903 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 30f34aae-76cf-4423-b9c0-db2ce701d138] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:17.382629 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-340b5d89-41e1-4f39-9199-9f50d7d08903 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:17.383075 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-340b5d89-41e1-4f39-9199-9f50d7d08903 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:17.383892 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-340b5d89-41e1-4f39-9199-9f50d7d08903 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:17.384336 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-340b5d89-41e1-4f39-9199-9f50d7d08903 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:17.513302 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-340b5d89-41e1-4f39-9199-9f50d7d08903 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:03:17.520758 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-340b5d89-41e1-4f39-9199-9f50d7d08903 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138" status: 200 len: 1264 microversion: 2.1 time: 0.149696 Jun 17 09:03:17.521322 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 577/1157] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:03:17 2022] GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:03:18.538609 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-1346a2fc-42e9-4dec-a69a-31da23d2e5d8 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:03:18.539284 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-1346a2fc-42e9-4dec-a69a-31da23d2e5d8 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 30f34aae-76cf-4423-b9c0-db2ce701d138] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:18.542728 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=2 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:03:18.547864 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1346a2fc-42e9-4dec-a69a-31da23d2e5d8 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:18.548379 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1346a2fc-42e9-4dec-a69a-31da23d2e5d8 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:18.549192 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1346a2fc-42e9-4dec-a69a-31da23d2e5d8 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:18.549634 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1346a2fc-42e9-4dec-a69a-31da23d2e5d8 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:18.681962 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-1346a2fc-42e9-4dec-a69a-31da23d2e5d8 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:03:18.689638 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-1346a2fc-42e9-4dec-a69a-31da23d2e5d8 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138" status: 200 len: 1264 microversion: 2.1 time: 0.155159 Jun 17 09:03:18.690207 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 581/1158] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:03:18 2022] GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:03:19.706201 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-f9898729-2c24-4baa-a156-99959b7ee50a tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:03:19.706744 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-f9898729-2c24-4baa-a156-99959b7ee50a tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 30f34aae-76cf-4423-b9c0-db2ce701d138] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:19.708562 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=2 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:03:19.709204 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=6 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:03:19.714855 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f9898729-2c24-4baa-a156-99959b7ee50a tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:19.715316 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f9898729-2c24-4baa-a156-99959b7ee50a tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:19.716096 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f9898729-2c24-4baa-a156-99959b7ee50a tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:19.716533 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f9898729-2c24-4baa-a156-99959b7ee50a tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:19.848183 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f9898729-2c24-4baa-a156-99959b7ee50a tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:03:19.856194 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-f9898729-2c24-4baa-a156-99959b7ee50a tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138" status: 200 len: 1264 microversion: 2.1 time: 0.154016 Jun 17 09:03:19.856763 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 578/1159] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:03:19 2022] GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:03:20.873719 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-9ba73af2-50c8-47dc-b4fa-d98b1419b686 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:03:20.874366 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-9ba73af2-50c8-47dc-b4fa-d98b1419b686 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 30f34aae-76cf-4423-b9c0-db2ce701d138] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:20.881121 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9ba73af2-50c8-47dc-b4fa-d98b1419b686 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:20.881571 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9ba73af2-50c8-47dc-b4fa-d98b1419b686 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:20.882333 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9ba73af2-50c8-47dc-b4fa-d98b1419b686 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:20.882768 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9ba73af2-50c8-47dc-b4fa-d98b1419b686 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:21.022784 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-9ba73af2-50c8-47dc-b4fa-d98b1419b686 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:03:21.031048 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-9ba73af2-50c8-47dc-b4fa-d98b1419b686 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138" status: 200 len: 1264 microversion: 2.1 time: 0.161120 Jun 17 09:03:21.031582 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 582/1160] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:03:20 2022] GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:03:22.047732 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-2fc728c8-e0c6-4cbd-81b6-aa8a7304ecf4 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:03:22.048690 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-2fc728c8-e0c6-4cbd-81b6-aa8a7304ecf4 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 30f34aae-76cf-4423-b9c0-db2ce701d138] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:22.055030 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2fc728c8-e0c6-4cbd-81b6-aa8a7304ecf4 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:22.055516 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2fc728c8-e0c6-4cbd-81b6-aa8a7304ecf4 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:22.056412 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2fc728c8-e0c6-4cbd-81b6-aa8a7304ecf4 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:22.056844 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2fc728c8-e0c6-4cbd-81b6-aa8a7304ecf4 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:22.189787 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2fc728c8-e0c6-4cbd-81b6-aa8a7304ecf4 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:03:22.197892 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-2fc728c8-e0c6-4cbd-81b6-aa8a7304ecf4 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138" status: 200 len: 1264 microversion: 2.1 time: 0.154094 Jun 17 09:03:22.198478 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 579/1161] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:03:22 2022] GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 09:03:22.690538 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-e63e0ba3-416f-4221-bc9f-e73fe915c745 req-907d55aa-280c-4d63-ae53-c5fcb3742bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30f34aae-76cf-4423-b9c0-db2ce701d138", "name": "network-vif-plugged", "status": "completed", "tag": "5841a5dd-f021-4da9-a952-f77917f1048b"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:03:22.699650 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-e63e0ba3-416f-4221-bc9f-e73fe915c745 req-907d55aa-280c-4d63-ae53-c5fcb3742bb6 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:22.700097 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-e63e0ba3-416f-4221-bc9f-e73fe915c745 req-907d55aa-280c-4d63-ae53-c5fcb3742bb6 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:22.711301 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-e63e0ba3-416f-4221-bc9f-e73fe915c745 req-907d55aa-280c-4d63-ae53-c5fcb3742bb6 service nova] Creating event network-vif-plugged:5841a5dd-f021-4da9-a952-f77917f1048b for instance 30f34aae-76cf-4423-b9c0-db2ce701d138 on hv-cinder-79760 Jun 17 09:03:22.717247 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-e63e0ba3-416f-4221-bc9f-e73fe915c745 req-907d55aa-280c-4d63-ae53-c5fcb3742bb6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030515 Jun 17 09:03:22.718246 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 583/1162] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 09:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:03:23.214921 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3c14f839-99c7-46f7-af16-8ab2178a6942 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:03:23.215596 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-3c14f839-99c7-46f7-af16-8ab2178a6942 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 30f34aae-76cf-4423-b9c0-db2ce701d138] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:23.222031 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3c14f839-99c7-46f7-af16-8ab2178a6942 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:23.222475 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3c14f839-99c7-46f7-af16-8ab2178a6942 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:23.223233 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3c14f839-99c7-46f7-af16-8ab2178a6942 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:23.223706 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3c14f839-99c7-46f7-af16-8ab2178a6942 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:23.354330 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3c14f839-99c7-46f7-af16-8ab2178a6942 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:03:23.362009 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-3c14f839-99c7-46f7-af16-8ab2178a6942 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138" status: 200 len: 1264 microversion: 2.1 time: 0.151518 Jun 17 09:03:23.362580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 580/1163] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:03:23 2022] GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:03:24.379565 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-af3bf5b3-1798-43ce-ac9f-6e4aeaf19203 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:03:24.380213 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-af3bf5b3-1798-43ce-ac9f-6e4aeaf19203 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 30f34aae-76cf-4423-b9c0-db2ce701d138] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:24.387932 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-af3bf5b3-1798-43ce-ac9f-6e4aeaf19203 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:24.388387 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-af3bf5b3-1798-43ce-ac9f-6e4aeaf19203 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:24.389150 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-af3bf5b3-1798-43ce-ac9f-6e4aeaf19203 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:24.389622 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-af3bf5b3-1798-43ce-ac9f-6e4aeaf19203 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:24.525766 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-af3bf5b3-1798-43ce-ac9f-6e4aeaf19203 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:03:24.533294 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-af3bf5b3-1798-43ce-ac9f-6e4aeaf19203 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138" status: 200 len: 1264 microversion: 2.1 time: 0.158758 Jun 17 09:03:24.533853 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 584/1164] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:03:24 2022] GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:03:25.550391 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-9121dd90-4dea-4711-9c67-af7a74123bca tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:03:25.550998 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-9121dd90-4dea-4711-9c67-af7a74123bca tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 30f34aae-76cf-4423-b9c0-db2ce701d138] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:25.557920 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9121dd90-4dea-4711-9c67-af7a74123bca tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:25.558361 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9121dd90-4dea-4711-9c67-af7a74123bca tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:25.559117 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9121dd90-4dea-4711-9c67-af7a74123bca tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:25.559583 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9121dd90-4dea-4711-9c67-af7a74123bca tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:25.690536 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-9121dd90-4dea-4711-9c67-af7a74123bca tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:03:25.698595 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-9121dd90-4dea-4711-9c67-af7a74123bca tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138" status: 200 len: 1450 microversion: 2.1 time: 0.152196 Jun 17 09:03:25.699162 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 581/1165] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:03:25 2022] GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:03:25.715106 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-196e61b7-d3b9-4de9-a23d-25ee2727555b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:03:25.715713 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-196e61b7-d3b9-4de9-a23d-25ee2727555b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 30f34aae-76cf-4423-b9c0-db2ce701d138] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:25.722162 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-196e61b7-d3b9-4de9-a23d-25ee2727555b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:25.722611 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-196e61b7-d3b9-4de9-a23d-25ee2727555b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:25.723381 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-196e61b7-d3b9-4de9-a23d-25ee2727555b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:25.723819 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-196e61b7-d3b9-4de9-a23d-25ee2727555b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:25.853903 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-196e61b7-d3b9-4de9-a23d-25ee2727555b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:03:25.861332 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-196e61b7-d3b9-4de9-a23d-25ee2727555b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138" status: 200 len: 1450 microversion: 2.1 time: 0.150974 Jun 17 09:03:25.861885 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 585/1166] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:03:25 2022] GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:03:27.965284 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-5feb101c-7f08-46e0-9298-d9cc4578363d req-d77dfbf1-cfe7-40b6-95e0-39db31e875bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30f34aae-76cf-4423-b9c0-db2ce701d138", "tag": "5841a5dd-f021-4da9-a952-f77917f1048b"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:03:27.973645 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-5feb101c-7f08-46e0-9298-d9cc4578363d req-d77dfbf1-cfe7-40b6-95e0-39db31e875bc service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:27.974091 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-5feb101c-7f08-46e0-9298-d9cc4578363d req-d77dfbf1-cfe7-40b6-95e0-39db31e875bc service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:27.984920 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-5feb101c-7f08-46e0-9298-d9cc4578363d req-d77dfbf1-cfe7-40b6-95e0-39db31e875bc service nova] Creating event network-changed:5841a5dd-f021-4da9-a952-f77917f1048b for instance 30f34aae-76cf-4423-b9c0-db2ce701d138 on hv-cinder-79760 Jun 17 09:03:27.989870 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-5feb101c-7f08-46e0-9298-d9cc4578363d req-d77dfbf1-cfe7-40b6-95e0-39db31e875bc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029014 Jun 17 09:03:27.990462 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 582/1167] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 09:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:03:34.287659 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-08847edb-a0b7-46db-849c-afe06fb19c9d tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:03:34.288223 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-08847edb-a0b7-46db-849c-afe06fb19c9d tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:34.295552 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-08847edb-a0b7-46db-849c-afe06fb19c9d tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:34.296005 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-08847edb-a0b7-46db-849c-afe06fb19c9d tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:34.296782 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-08847edb-a0b7-46db-849c-afe06fb19c9d tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:34.297228 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-08847edb-a0b7-46db-849c-afe06fb19c9d tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:34.320183 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-08847edb-a0b7-46db-849c-afe06fb19c9d tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/ips" status: 200 len: 144 microversion: 2.1 time: 0.036434 Jun 17 09:03:34.320746 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 586/1168] 10.222.0.78 () {58 vars in 1247 bytes} [Fri Jun 17 09:03:34 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/ips => generated 144 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:03:37.297318 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-6057217e-a1c3-4305-927b-cba3fdc6af2f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f08a8ec-d39b-479e-b991-42702de2b790"}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:03:37.298513 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-6057217e-a1c3-4305-927b-cba3fdc6af2f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:37.300653 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:03:37.306064 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6057217e-a1c3-4305-927b-cba3fdc6af2f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:37.306538 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6057217e-a1c3-4305-927b-cba3fdc6af2f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:37.307308 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6057217e-a1c3-4305-927b-cba3fdc6af2f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:37.307786 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6057217e-a1c3-4305-927b-cba3fdc6af2f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:37.310238 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=59 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:03:38.350319 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-6057217e-a1c3-4305-927b-cba3fdc6af2f tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "POST /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.058048 Jun 17 09:03:38.351045 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 583/1169] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jun 17 09:03:37 2022] POST /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-volume_attachments => generated 194 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:03:45.834182 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e1c8a656-fc53-41db-b531-6d2196641e6a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:03:45.835170 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-e1c8a656-fc53-41db-b531-6d2196641e6a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:45.837432 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_api:SELECT=23 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:03:45.838084 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=50 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:03:45.842747 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e1c8a656-fc53-41db-b531-6d2196641e6a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:45.843216 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e1c8a656-fc53-41db-b531-6d2196641e6a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:45.843999 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e1c8a656-fc53-41db-b531-6d2196641e6a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:45.844445 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e1c8a656-fc53-41db-b531-6d2196641e6a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:45.874899 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-e1c8a656-fc53-41db-b531-6d2196641e6a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044638 Jun 17 09:03:45.878124 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 587/1170] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 09:03:45 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:03:45.886546 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-bbf72d03-9ceb-41d2-9797-06ad600b2f0c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:03:45.887131 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-bbf72d03-9ceb-41d2-9797-06ad600b2f0c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:45.893343 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bbf72d03-9ceb-41d2-9797-06ad600b2f0c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:45.893796 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bbf72d03-9ceb-41d2-9797-06ad600b2f0c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:45.894572 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bbf72d03-9ceb-41d2-9797-06ad600b2f0c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:45.895041 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-bbf72d03-9ceb-41d2-9797-06ad600b2f0c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:45.923767 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-bbf72d03-9ceb-41d2-9797-06ad600b2f0c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-volume_attachments/7f08a8ec-d39b-479e-b991-42702de2b790" status: 200 len: 194 microversion: 2.1 time: 0.042204 Jun 17 09:03:45.924343 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 584/1171] 10.222.0.78 () {58 vars in 1412 bytes} [Fri Jun 17 09:03:45 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-volume_attachments/7f08a8ec-d39b-479e-b991-42702de2b790 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:03:47.699381 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-26617555-68d2-4a0d-ba1f-2efcbd5801d5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5efe6e2-e2eb-4fe5-b7c6-7457c95ed0b8"}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:03:47.700498 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-26617555-68d2-4a0d-ba1f-2efcbd5801d5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:47.707098 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-26617555-68d2-4a0d-ba1f-2efcbd5801d5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:47.707598 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-26617555-68d2-4a0d-ba1f-2efcbd5801d5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:47.708377 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-26617555-68d2-4a0d-ba1f-2efcbd5801d5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:47.708816 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-26617555-68d2-4a0d-ba1f-2efcbd5801d5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:48.556429 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-26617555-68d2-4a0d-ba1f-2efcbd5801d5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "POST /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.862034 Jun 17 09:03:48.557054 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 588/1172] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jun 17 09:03:47 2022] POST /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-volume_attachments => generated 194 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:03:56.046164 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3dc6a36f-f338-46dd-b457-a01487dffb40 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:03:56.047040 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-3dc6a36f-f338-46dd-b457-a01487dffb40 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:56.049539 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=3 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:03:56.050192 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:03:56.055133 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3dc6a36f-f338-46dd-b457-a01487dffb40 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:56.057292 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3dc6a36f-f338-46dd-b457-a01487dffb40 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:56.057292 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3dc6a36f-f338-46dd-b457-a01487dffb40 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:56.057292 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3dc6a36f-f338-46dd-b457-a01487dffb40 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:56.087692 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-3dc6a36f-f338-46dd-b457-a01487dffb40 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045874 Jun 17 09:03:56.088244 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 585/1173] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 09:03:56 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:03:56.238225 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-bc88a1f8-fc90-400f-a7bd-28d3e3681c0c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:03:56.238811 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-bc88a1f8-fc90-400f-a7bd-28d3e3681c0c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:56.245701 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bc88a1f8-fc90-400f-a7bd-28d3e3681c0c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:56.246195 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bc88a1f8-fc90-400f-a7bd-28d3e3681c0c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:56.247815 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bc88a1f8-fc90-400f-a7bd-28d3e3681c0c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:56.248263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bc88a1f8-fc90-400f-a7bd-28d3e3681c0c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:56.278249 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-bc88a1f8-fc90-400f-a7bd-28d3e3681c0c tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-volume_attachments/7f08a8ec-d39b-479e-b991-42702de2b790" status: 200 len: 194 microversion: 2.1 time: 0.044942 Jun 17 09:03:56.278836 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 589/1174] 10.222.0.78 () {58 vars in 1412 bytes} [Fri Jun 17 09:03:56 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-volume_attachments/7f08a8ec-d39b-479e-b991-42702de2b790 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:03:56.289263 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-a016f2a9-af5f-4ea6-8ddc-7ea72261aec6 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:03:56.289763 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-a016f2a9-af5f-4ea6-8ddc-7ea72261aec6 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:56.297424 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a016f2a9-af5f-4ea6-8ddc-7ea72261aec6 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:56.297789 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a016f2a9-af5f-4ea6-8ddc-7ea72261aec6 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:56.298548 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a016f2a9-af5f-4ea6-8ddc-7ea72261aec6 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:56.298982 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-a016f2a9-af5f-4ea6-8ddc-7ea72261aec6 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:56.379829 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-a016f2a9-af5f-4ea6-8ddc-7ea72261aec6 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lazy-loading 'services' on Instance uuid 290903b6-0ce5-4bf4-a25e-0f15abc014c2 {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 09:03:56.630998 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-a016f2a9-af5f-4ea6-8ddc-7ea72261aec6 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "DELETE /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-volume_attachments/7f08a8ec-d39b-479e-b991-42702de2b790" status: 202 len: 0 microversion: 2.1 time: 0.345771 Jun 17 09:03:56.631532 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 586/1175] 10.222.0.78 () {58 vars in 1415 bytes} [Fri Jun 17 09:03:56 2022] DELETE /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-volume_attachments/7f08a8ec-d39b-479e-b991-42702de2b790 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 09:03:58.793437 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a949cf2f-a1ff-4a93-b084-608af58ed7e1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:03:58.793944 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a949cf2f-a1ff-4a93-b084-608af58ed7e1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:58.800948 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a949cf2f-a1ff-4a93-b084-608af58ed7e1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:58.801404 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a949cf2f-a1ff-4a93-b084-608af58ed7e1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:58.802162 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a949cf2f-a1ff-4a93-b084-608af58ed7e1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:58.802596 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a949cf2f-a1ff-4a93-b084-608af58ed7e1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:58.831795 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a949cf2f-a1ff-4a93-b084-608af58ed7e1 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-volume_attachments/f5efe6e2-e2eb-4fe5-b7c6-7457c95ed0b8" status: 200 len: 194 microversion: 2.1 time: 0.042220 Jun 17 09:03:58.832377 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 590/1176] 10.222.0.78 () {58 vars in 1412 bytes} [Fri Jun 17 09:03:58 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-volume_attachments/f5efe6e2-e2eb-4fe5-b7c6-7457c95ed0b8 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:03:58.844208 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-90610c4e-9c7c-4dc6-9890-50f8d81745d5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:03:58.844801 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-90610c4e-9c7c-4dc6-9890-50f8d81745d5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:03:58.851109 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-90610c4e-9c7c-4dc6-9890-50f8d81745d5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:58.851634 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-90610c4e-9c7c-4dc6-9890-50f8d81745d5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:58.852461 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-90610c4e-9c7c-4dc6-9890-50f8d81745d5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:03:58.852902 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-90610c4e-9c7c-4dc6-9890-50f8d81745d5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:03:58.939391 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-90610c4e-9c7c-4dc6-9890-50f8d81745d5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lazy-loading 'services' on Instance uuid 290903b6-0ce5-4bf4-a25e-0f15abc014c2 {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 09:03:59.422352 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-90610c4e-9c7c-4dc6-9890-50f8d81745d5 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "DELETE /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-volume_attachments/f5efe6e2-e2eb-4fe5-b7c6-7457c95ed0b8" status: 202 len: 0 microversion: 2.1 time: 0.583839 Jun 17 09:03:59.422941 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 587/1177] 10.222.0.78 () {58 vars in 1415 bytes} [Fri Jun 17 09:03:58 2022] DELETE /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-volume_attachments/f5efe6e2-e2eb-4fe5-b7c6-7457c95ed0b8 => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 09:04:00.586268 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-af8d6848-035d-4e1c-9d4e-d36237cd428a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:04:00.593136 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-af8d6848-035d-4e1c-9d4e-d36237cd428a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:04:00.594355 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-af8d6848-035d-4e1c-9d4e-d36237cd428a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:00.594840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-af8d6848-035d-4e1c-9d4e-d36237cd428a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:00.595719 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-af8d6848-035d-4e1c-9d4e-d36237cd428a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:00.596168 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-af8d6848-035d-4e1c-9d4e-d36237cd428a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:00.626559 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-af8d6848-035d-4e1c-9d4e-d36237cd428a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044199 Jun 17 09:04:00.639454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 591/1178] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 09:04:00 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:04:01.639661 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-53a41c5f-1566-4897-8365-55d32e4595ad tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:04:01.640720 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-53a41c5f-1566-4897-8365-55d32e4595ad tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:04:01.646917 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-53a41c5f-1566-4897-8365-55d32e4595ad tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:01.647399 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-53a41c5f-1566-4897-8365-55d32e4595ad tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:01.648163 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-53a41c5f-1566-4897-8365-55d32e4595ad tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:01.648601 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-53a41c5f-1566-4897-8365-55d32e4595ad tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:01.677009 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-53a41c5f-1566-4897-8365-55d32e4595ad tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042344 Jun 17 09:04:01.677559 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 588/1179] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 09:04:01 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 09:04:01.781784 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-9ddea49c-a98b-44be-9f36-bd89c647d59e tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:04:01.782714 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-9ddea49c-a98b-44be-9f36-bd89c647d59e tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:04:01.789357 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9ddea49c-a98b-44be-9f36-bd89c647d59e tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:01.789805 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9ddea49c-a98b-44be-9f36-bd89c647d59e tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:01.790588 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9ddea49c-a98b-44be-9f36-bd89c647d59e tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:01.791007 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-9ddea49c-a98b-44be-9f36-bd89c647d59e tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:01.820433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-9ddea49c-a98b-44be-9f36-bd89c647d59e tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043091 Jun 17 09:04:01.820997 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 592/1180] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jun 17 09:04:01 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 09:04:01.881283 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-c00f815c-c1df-421e-a6c6-fbc174f43056 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:04:01.881790 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-c00f815c-c1df-421e-a6c6-fbc174f43056 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:04:01.890069 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c00f815c-c1df-421e-a6c6-fbc174f43056 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:01.890530 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c00f815c-c1df-421e-a6c6-fbc174f43056 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:01.891299 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c00f815c-c1df-421e-a6c6-fbc174f43056 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:01.892346 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-c00f815c-c1df-421e-a6c6-fbc174f43056 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:01.917546 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-c00f815c-c1df-421e-a6c6-fbc174f43056 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Going to try to terminate instance {{(pid=129875) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 09:04:02.268850 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-c00f815c-c1df-421e-a6c6-fbc174f43056 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "DELETE /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2" status: 204 len: 0 microversion: 2.1 time: 0.391196 Jun 17 09:04:02.269444 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 589/1181] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 09:04:01 2022] DELETE /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 09:04:02.277773 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-e37971d9-baf2-4008-9214-f5447ffc2ba9 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:04:02.281698 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-e37971d9-baf2-4008-9214-f5447ffc2ba9 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:04:02.285776 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e37971d9-baf2-4008-9214-f5447ffc2ba9 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:02.286283 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e37971d9-baf2-4008-9214-f5447ffc2ba9 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:02.287030 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e37971d9-baf2-4008-9214-f5447ffc2ba9 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:02.287500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-e37971d9-baf2-4008-9214-f5447ffc2ba9 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:02.418788 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-e37971d9-baf2-4008-9214-f5447ffc2ba9 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:04:02.426334 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-e37971d9-baf2-4008-9214-f5447ffc2ba9 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2" status: 200 len: 1672 microversion: 2.1 time: 0.152645 Jun 17 09:04:02.426905 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 593/1182] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:04:02 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:04:03.444365 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-6aeda1af-be1e-45b3-8dbf-f8b853223de6 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:04:03.445090 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-6aeda1af-be1e-45b3-8dbf-f8b853223de6 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:04:03.452746 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6aeda1af-be1e-45b3-8dbf-f8b853223de6 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:03.453221 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6aeda1af-be1e-45b3-8dbf-f8b853223de6 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:03.454003 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6aeda1af-be1e-45b3-8dbf-f8b853223de6 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:03.454450 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-6aeda1af-be1e-45b3-8dbf-f8b853223de6 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:03.585571 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-6aeda1af-be1e-45b3-8dbf-f8b853223de6 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:04:03.593046 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-6aeda1af-be1e-45b3-8dbf-f8b853223de6 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2" status: 200 len: 1672 microversion: 2.1 time: 0.153013 Jun 17 09:04:03.593605 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 590/1183] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:04:03 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:04:04.610388 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-3f0b386e-ffb1-4e10-9dbd-cad4c1f63b75 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:04:04.611005 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-3f0b386e-ffb1-4e10-9dbd-cad4c1f63b75 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:04:04.617681 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3f0b386e-ffb1-4e10-9dbd-cad4c1f63b75 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:04.618056 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3f0b386e-ffb1-4e10-9dbd-cad4c1f63b75 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:04.618850 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3f0b386e-ffb1-4e10-9dbd-cad4c1f63b75 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:04.619291 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-3f0b386e-ffb1-4e10-9dbd-cad4c1f63b75 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:04.689683 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-3f0b386e-ffb1-4e10-9dbd-cad4c1f63b75 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:04:04.704227 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-3f0b386e-ffb1-4e10-9dbd-cad4c1f63b75 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2" status: 200 len: 1604 microversion: 2.1 time: 0.092254 Jun 17 09:04:04.704227 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 594/1184] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:04:04 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2 => generated 1604 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:04:05.223979 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-3902c91e-f582-4b83-80d4-38053bf12c48 req-34e94c90-2a2d-4d9e-9705-b520fa9d077a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "290903b6-0ce5-4bf4-a25e-0f15abc014c2", "name": "network-vif-deleted", "tag": "2c23f345-ee57-4a33-b2ff-9bafffa96644"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:04:05.234283 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-3902c91e-f582-4b83-80d4-38053bf12c48 req-34e94c90-2a2d-4d9e-9705-b520fa9d077a service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:05.234733 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-3902c91e-f582-4b83-80d4-38053bf12c48 req-34e94c90-2a2d-4d9e-9705-b520fa9d077a service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:05.246530 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-3902c91e-f582-4b83-80d4-38053bf12c48 req-34e94c90-2a2d-4d9e-9705-b520fa9d077a service nova] Creating event network-vif-deleted:2c23f345-ee57-4a33-b2ff-9bafffa96644 for instance 290903b6-0ce5-4bf4-a25e-0f15abc014c2 on hv-cinder-79760 Jun 17 09:04:05.254276 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-3902c91e-f582-4b83-80d4-38053bf12c48 req-34e94c90-2a2d-4d9e-9705-b520fa9d077a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032106 Jun 17 09:04:05.254276 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 591/1185] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 09:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:04:05.717159 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-0c1c4cb5-abd4-46d1-b88e-72a176820e79 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:04:05.718458 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-0c1c4cb5-abd4-46d1-b88e-72a176820e79 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:04:05.725433 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0c1c4cb5-abd4-46d1-b88e-72a176820e79 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:05.725884 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0c1c4cb5-abd4-46d1-b88e-72a176820e79 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:05.726649 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0c1c4cb5-abd4-46d1-b88e-72a176820e79 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:05.727083 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0c1c4cb5-abd4-46d1-b88e-72a176820e79 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:05.760340 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0c1c4cb5-abd4-46d1-b88e-72a176820e79 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:05.760791 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0c1c4cb5-abd4-46d1-b88e-72a176820e79 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:05.761246 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.objects.instance [None req-0c1c4cb5-abd4-46d1-b88e-72a176820e79 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lazy-loading 'fault' on Instance uuid 290903b6-0ce5-4bf4-a25e-0f15abc014c2 {{(pid=129876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 09:04:05.804067 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-0c1c4cb5-abd4-46d1-b88e-72a176820e79 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449850e1f8d144eb8b330a764882a099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0964a125c554efe858f7695016de8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:04:05.812404 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-0c1c4cb5-abd4-46d1-b88e-72a176820e79 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2" status: 200 len: 1327 microversion: 2.1 time: 0.098595 Jun 17 09:04:05.812993 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 595/1186] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:04:05 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2 => generated 1327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:04:06.831055 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-19a2e182-2a8e-4845-9a52-9ad780548371 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:04:06.831779 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-19a2e182-2a8e-4845-9a52-9ad780548371 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:04:06.837975 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-19a2e182-2a8e-4845-9a52-9ad780548371 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:06.838423 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-19a2e182-2a8e-4845-9a52-9ad780548371 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:06.839191 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-19a2e182-2a8e-4845-9a52-9ad780548371 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:06.839685 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-19a2e182-2a8e-4845-9a52-9ad780548371 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:06.853976 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-19a2e182-2a8e-4845-9a52-9ad780548371 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] HTTP exception thrown: Instance 290903b6-0ce5-4bf4-a25e-0f15abc014c2 could not be found. Jun 17 09:04:06.855667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-19a2e182-2a8e-4845-9a52-9ad780548371 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Request method failure captured: Jun 17 09:04:06.855667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2 HTTP/1.1 Jun 17 09:04:06.855667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 09:04:06.855667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 09:04:06.855667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 09:04:06.855667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 09:04:06.855667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 09:04:06.855667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 09:04:06.855667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 09:04:06.855667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 09:04:06.855667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirEKD1DEWRZVRUveV5UEZzucfNrYDHwPR19E9HSeuTAJvYtv-tRMSey7zis4DE7QWyLY9sP3u8vZ9YZaCir2zfM9yx-3yfXT3ZzT7BhAc5PMkJx1scolSO_aoqUUnCeRoZHDslCqc1M2LaLnuzVzGAXFKThgGs8lzrOZKQDGy1Ael5Rk Jun 17 09:04:06.855667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 09:04:06.855667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 09:04:06.855667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 09:04:06.855667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 09:04:06.855667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 09:04:06.855667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 09:04:06.855667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: f0964a125c554efe858f7695016de8db Jun 17 09:04:06.855667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-AttachVolumeTestJSON-1223322254 Jun 17 09:04:06.855667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 09:04:06.855667 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 09:04:06.857318 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f0964a125c554efe858f7695016de8db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f0964a125c554efe858f7695016de8db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f0964a125c554efe858f7695016de8db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f0964a125c554efe858f7695016de8db"}]}] Jun 17 09:04:06.857318 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-AttachVolumeTestJSON-1223322254 Jun 17 09:04:06.857318 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: f0964a125c554efe858f7695016de8db Jun 17 09:04:06.857318 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1223322254 Jun 17 09:04:06.857318 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-AttachVolumeTestJSON-1223322254-project Jun 17 09:04:06.857318 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 09:04:06.857318 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 09:04:06.857318 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: 449850e1f8d144eb8b330a764882a099 Jun 17 09:04:06.857318 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-AttachVolumeTestJSON-1223322254-project Jun 17 09:04:06.857318 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: > Jun 17 09:04:06.857318 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Instance 290903b6-0ce5-4bf4-a25e-0f15abc014c2 could not be found. Jun 17 09:04:06.857318 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'id': '290903b6-0ce5-4bf4-a25e-0f15abc014c2'} Jun 17 09:04:06.858312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 09:04:06.858312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:04:06.858312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 09:04:06.858312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 09:04:06.858312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 09:04:06.858312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 09:04:06.858312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 09:04:06.858312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 09:04:06.858312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 09:04:06.858312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 09:04:06.858312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 290903b6-0ce5-4bf4-a25e-0f15abc014c2 could not be found. Jun 17 09:04:06.858312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:04:06.858312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:04:06.858312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:04:06.858312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:04:06.858312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:04:06.858312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:04:06.858312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 09:04:06.858312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 09:04:06.858312 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 09:04:06.860062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 09:04:06.860062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 09:04:06.860062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 09:04:06.860062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 09:04:06.860062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 09:04:06.860062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 09:04:06.860062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 09:04:06.860062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 290903b6-0ce5-4bf4-a25e-0f15abc014c2 could not be found. Jun 17 09:04:06.860062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:04:06.860062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:04:06.860062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:04:06.860062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:04:06.860062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:04:06.860062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:04:06.860062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 09:04:06.860062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 09:04:06.860062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 290903b6-0ce5-4bf4-a25e-0f15abc014c2 could not be found. Jun 17 09:04:06.860062 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:04:06.861433 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-19a2e182-2a8e-4845-9a52-9ad780548371 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Returning 404 to user: Instance 290903b6-0ce5-4bf4-a25e-0f15abc014c2 could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 09:04:06.861433 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-19a2e182-2a8e-4845-9a52-9ad780548371 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2" status: 404 len: 111 microversion: 2.1 time: 0.031368 Jun 17 09:04:06.861433 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 592/1187] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:04:06 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 09:04:06.865991 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-49b6336c-ec02-4abe-8174-d5ae923c462a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '.version_select at 0x7fbc33bda550>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:04:06.975622 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-49b6336c-ec02-4abe-8174-d5ae923c462a tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1506951956" status: 202 len: 0 microversion: 2.1 time: 0.113290 Jun 17 09:04:06.976197 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 596/1188] 10.222.0.78 () {58 vars in 1220 bytes} [Fri Jun 17 09:04:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1506951956 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 09:04:10.398738 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-e3d4815d-cd7d-4f3f-a3c9-0b0ff504d12b tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:04:10.399244 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-e3d4815d-cd7d-4f3f-a3c9-0b0ff504d12b tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:04:10.406590 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e3d4815d-cd7d-4f3f-a3c9-0b0ff504d12b tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:10.407071 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e3d4815d-cd7d-4f3f-a3c9-0b0ff504d12b tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:10.407874 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e3d4815d-cd7d-4f3f-a3c9-0b0ff504d12b tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:10.408308 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-e3d4815d-cd7d-4f3f-a3c9-0b0ff504d12b tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:10.421930 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-e3d4815d-cd7d-4f3f-a3c9-0b0ff504d12b tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] HTTP exception thrown: Instance 290903b6-0ce5-4bf4-a25e-0f15abc014c2 could not be found. Jun 17 09:04:10.423576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-e3d4815d-cd7d-4f3f-a3c9-0b0ff504d12b tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Request method failure captured: Jun 17 09:04:10.423576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: DELETE /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2 HTTP/1.1 Jun 17 09:04:10.423576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 09:04:10.423576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 09:04:10.423576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 09:04:10.423576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 09:04:10.423576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 09:04:10.423576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 09:04:10.423576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 09:04:10.423576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 09:04:10.423576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirEKD1DEWRZVRUveV5UEZzucfNrYDHwPR19E9HSeuTAJvYtv-tRMSey7zis4DE7QWyLY9sP3u8vZ9YZaCir2zfM9yx-3yfXT3ZzT7BhAc5PMkJx1scolSO_aoqUUnCeRoZHDslCqc1M2LaLnuzVzGAXFKThgGs8lzrOZKQDGy1Ael5Rk Jun 17 09:04:10.423576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 09:04:10.423576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 09:04:10.423576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 09:04:10.423576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 09:04:10.423576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 09:04:10.423576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 09:04:10.423576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: f0964a125c554efe858f7695016de8db Jun 17 09:04:10.423576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-AttachVolumeTestJSON-1223322254 Jun 17 09:04:10.423576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 09:04:10.423576 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 09:04:10.425087 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f0964a125c554efe858f7695016de8db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f0964a125c554efe858f7695016de8db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f0964a125c554efe858f7695016de8db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f0964a125c554efe858f7695016de8db"}]}] Jun 17 09:04:10.425087 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-AttachVolumeTestJSON-1223322254 Jun 17 09:04:10.425087 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: f0964a125c554efe858f7695016de8db Jun 17 09:04:10.425087 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1223322254 Jun 17 09:04:10.425087 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-AttachVolumeTestJSON-1223322254-project Jun 17 09:04:10.425087 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 09:04:10.425087 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 09:04:10.425087 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: 449850e1f8d144eb8b330a764882a099 Jun 17 09:04:10.425087 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-AttachVolumeTestJSON-1223322254-project Jun 17 09:04:10.425087 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: > Jun 17 09:04:10.425087 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Instance 290903b6-0ce5-4bf4-a25e-0f15abc014c2 could not be found. Jun 17 09:04:10.425087 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'id': '290903b6-0ce5-4bf4-a25e-0f15abc014c2'} Jun 17 09:04:10.425872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 09:04:10.425872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:04:10.425872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 09:04:10.425872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 09:04:10.425872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 09:04:10.425872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 09:04:10.425872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 09:04:10.425872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 09:04:10.425872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 09:04:10.425872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 09:04:10.425872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 290903b6-0ce5-4bf4-a25e-0f15abc014c2 could not be found. Jun 17 09:04:10.425872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:04:10.425872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:04:10.425872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:04:10.425872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:04:10.425872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:04:10.425872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:04:10.425872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 09:04:10.425872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 09:04:10.425872 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 09:04:10.427384 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 09:04:10.427384 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 09:04:10.427384 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 09:04:10.427384 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 09:04:10.427384 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 09:04:10.427384 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 09:04:10.427384 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 09:04:10.427384 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 09:04:10.427384 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 09:04:10.427384 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 290903b6-0ce5-4bf4-a25e-0f15abc014c2 could not be found. Jun 17 09:04:10.427384 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:04:10.427384 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:04:10.427384 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:04:10.427384 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:04:10.427384 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:04:10.427384 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:04:10.427384 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 09:04:10.427384 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 09:04:10.427384 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 290903b6-0ce5-4bf4-a25e-0f15abc014c2 could not be found. Jun 17 09:04:10.427384 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:04:10.429256 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-e3d4815d-cd7d-4f3f-a3c9-0b0ff504d12b tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Returning 404 to user: Instance 290903b6-0ce5-4bf4-a25e-0f15abc014c2 could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 09:04:10.429256 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-e3d4815d-cd7d-4f3f-a3c9-0b0ff504d12b tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "DELETE /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2" status: 404 len: 111 microversion: 2.1 time: 0.030255 Jun 17 09:04:10.429256 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 593/1189] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 09:04:10 2022] DELETE /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 09:04:10.435085 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-b11d1a5b-2805-482e-aec6-59289c68ffd7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:04:10.435734 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-b11d1a5b-2805-482e-aec6-59289c68ffd7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: 290903b6-0ce5-4bf4-a25e-0f15abc014c2] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:04:10.442454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b11d1a5b-2805-482e-aec6-59289c68ffd7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:10.442912 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b11d1a5b-2805-482e-aec6-59289c68ffd7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:10.443697 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b11d1a5b-2805-482e-aec6-59289c68ffd7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:10.444138 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-b11d1a5b-2805-482e-aec6-59289c68ffd7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:10.458101 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-b11d1a5b-2805-482e-aec6-59289c68ffd7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] HTTP exception thrown: Instance 290903b6-0ce5-4bf4-a25e-0f15abc014c2 could not be found. Jun 17 09:04:10.459807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-b11d1a5b-2805-482e-aec6-59289c68ffd7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Request method failure captured: Jun 17 09:04:10.459807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2 HTTP/1.1 Jun 17 09:04:10.459807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 09:04:10.459807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 09:04:10.459807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 09:04:10.459807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 09:04:10.459807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 09:04:10.459807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 09:04:10.459807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 09:04:10.459807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 09:04:10.459807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirEKD1DEWRZVRUveV5UEZzucfNrYDHwPR19E9HSeuTAJvYtv-tRMSey7zis4DE7QWyLY9sP3u8vZ9YZaCir2zfM9yx-3yfXT3ZzT7BhAc5PMkJx1scolSO_aoqUUnCeRoZHDslCqc1M2LaLnuzVzGAXFKThgGs8lzrOZKQDGy1Ael5Rk Jun 17 09:04:10.459807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 09:04:10.459807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 09:04:10.459807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 09:04:10.459807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 09:04:10.459807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 09:04:10.459807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 09:04:10.459807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: f0964a125c554efe858f7695016de8db Jun 17 09:04:10.459807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-AttachVolumeTestJSON-1223322254 Jun 17 09:04:10.459807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 09:04:10.459807 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 09:04:10.461412 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f0964a125c554efe858f7695016de8db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f0964a125c554efe858f7695016de8db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f0964a125c554efe858f7695016de8db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f0964a125c554efe858f7695016de8db"}]}] Jun 17 09:04:10.461412 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-AttachVolumeTestJSON-1223322254 Jun 17 09:04:10.461412 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: f0964a125c554efe858f7695016de8db Jun 17 09:04:10.461412 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1223322254 Jun 17 09:04:10.461412 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-AttachVolumeTestJSON-1223322254-project Jun 17 09:04:10.461412 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 09:04:10.461412 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 09:04:10.461412 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: 449850e1f8d144eb8b330a764882a099 Jun 17 09:04:10.461412 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-AttachVolumeTestJSON-1223322254-project Jun 17 09:04:10.461412 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 09:04:10.461412 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Instance 290903b6-0ce5-4bf4-a25e-0f15abc014c2 could not be found. Jun 17 09:04:10.461412 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'id': '290903b6-0ce5-4bf4-a25e-0f15abc014c2'} Jun 17 09:04:10.462290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 09:04:10.462290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:04:10.462290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 09:04:10.462290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 09:04:10.462290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 09:04:10.462290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 09:04:10.462290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 09:04:10.462290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 09:04:10.462290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 09:04:10.462290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 09:04:10.462290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 290903b6-0ce5-4bf4-a25e-0f15abc014c2 could not be found. Jun 17 09:04:10.462290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:04:10.462290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:04:10.462290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:04:10.462290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:04:10.462290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:04:10.462290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:04:10.462290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 09:04:10.462290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 09:04:10.462290 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 09:04:10.463851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 09:04:10.463851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 09:04:10.463851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 09:04:10.463851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 09:04:10.463851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 09:04:10.463851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 09:04:10.463851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 09:04:10.463851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 290903b6-0ce5-4bf4-a25e-0f15abc014c2 could not be found. Jun 17 09:04:10.463851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:04:10.463851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:04:10.463851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:04:10.463851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:04:10.463851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:04:10.463851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:04:10.463851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 09:04:10.463851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 09:04:10.463851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 290903b6-0ce5-4bf4-a25e-0f15abc014c2 could not be found. Jun 17 09:04:10.463851 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:04:10.465327 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-b11d1a5b-2805-482e-aec6-59289c68ffd7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Returning 404 to user: Instance 290903b6-0ce5-4bf4-a25e-0f15abc014c2 could not be found. {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 09:04:10.465327 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-b11d1a5b-2805-482e-aec6-59289c68ffd7 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2" status: 404 len: 111 microversion: 2.1 time: 0.030576 Jun 17 09:04:10.465327 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 597/1190] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:04:10 2022] GET /compute/v2.1/servers/290903b6-0ce5-4bf4-a25e-0f15abc014c2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 09:04:11.705492 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-971893bd-e108-4a42-98ab-f7618f4b3439 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:04:11.706072 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-971893bd-e108-4a42-98ab-f7618f4b3439 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:04:11.712477 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-971893bd-e108-4a42-98ab-f7618f4b3439 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:11.712921 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-971893bd-e108-4a42-98ab-f7618f4b3439 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:11.713679 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-971893bd-e108-4a42-98ab-f7618f4b3439 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:11.714109 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-971893bd-e108-4a42-98ab-f7618f4b3439 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:11.728006 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-971893bd-e108-4a42-98ab-f7618f4b3439 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] HTTP exception thrown: Instance d29e3483-56d1-40fb-a15f-5a57da6e5475 could not be found. Jun 17 09:04:11.729569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-971893bd-e108-4a42-98ab-f7618f4b3439 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Request method failure captured: Jun 17 09:04:11.729569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: DELETE /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 HTTP/1.1 Jun 17 09:04:11.729569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 09:04:11.729569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 09:04:11.729569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 09:04:11.729569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 09:04:11.729569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 09:04:11.729569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 09:04:11.729569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 09:04:11.729569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 09:04:11.729569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirEKD1DEWRZVRUveV5UEZzucfNrYDHwPR19E9HSeuTAJvYtv-tRMSey7zis4DE7QWyLY9sP3u8vZ9YZaCir2zfM9yx-3yfXT3ZzT7BhAc5PMkJx1scolSO_aoqUUnCeRoZHDslCqc1M2LaLnuzVzGAXFKThgGs8lzrOZKQDGy1Ael5Rk Jun 17 09:04:11.729569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 09:04:11.729569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 09:04:11.729569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 09:04:11.729569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 09:04:11.729569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 09:04:11.729569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 09:04:11.729569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: f0964a125c554efe858f7695016de8db Jun 17 09:04:11.729569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-AttachVolumeTestJSON-1223322254 Jun 17 09:04:11.729569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 09:04:11.729569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 09:04:11.731208 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f0964a125c554efe858f7695016de8db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f0964a125c554efe858f7695016de8db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f0964a125c554efe858f7695016de8db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f0964a125c554efe858f7695016de8db"}]}] Jun 17 09:04:11.731208 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-AttachVolumeTestJSON-1223322254 Jun 17 09:04:11.731208 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: f0964a125c554efe858f7695016de8db Jun 17 09:04:11.731208 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1223322254 Jun 17 09:04:11.731208 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-AttachVolumeTestJSON-1223322254-project Jun 17 09:04:11.731208 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 09:04:11.731208 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 09:04:11.731208 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: 449850e1f8d144eb8b330a764882a099 Jun 17 09:04:11.731208 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-AttachVolumeTestJSON-1223322254-project Jun 17 09:04:11.731208 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: > Jun 17 09:04:11.731208 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Instance d29e3483-56d1-40fb-a15f-5a57da6e5475 could not be found. Jun 17 09:04:11.731208 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'id': 'd29e3483-56d1-40fb-a15f-5a57da6e5475'} Jun 17 09:04:11.732290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 09:04:11.732290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:04:11.732290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 09:04:11.732290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 09:04:11.732290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 09:04:11.732290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 09:04:11.732290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 09:04:11.732290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 09:04:11.732290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 09:04:11.732290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 09:04:11.732290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d29e3483-56d1-40fb-a15f-5a57da6e5475 could not be found. Jun 17 09:04:11.732290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:04:11.732290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:04:11.732290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:04:11.732290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:04:11.732290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:04:11.732290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:04:11.732290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 09:04:11.732290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 09:04:11.732290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 09:04:11.733800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 09:04:11.733800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 09:04:11.733800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 09:04:11.733800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 09:04:11.733800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 09:04:11.733800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 09:04:11.733800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 09:04:11.733800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 09:04:11.733800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 09:04:11.733800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d29e3483-56d1-40fb-a15f-5a57da6e5475 could not be found. Jun 17 09:04:11.733800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:04:11.733800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:04:11.733800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:04:11.733800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:04:11.733800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:04:11.733800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:04:11.733800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 09:04:11.733800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 09:04:11.733800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d29e3483-56d1-40fb-a15f-5a57da6e5475 could not be found. Jun 17 09:04:11.733800 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:04:11.736399 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-971893bd-e108-4a42-98ab-f7618f4b3439 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Returning 404 to user: Instance d29e3483-56d1-40fb-a15f-5a57da6e5475 could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 09:04:11.736399 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-971893bd-e108-4a42-98ab-f7618f4b3439 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 404 len: 111 microversion: 2.1 time: 0.029706 Jun 17 09:04:11.736399 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 594/1191] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 09:04:11 2022] DELETE /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 09:04:11.740032 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-901b0f8d-baae-458a-8d8f-b4e5e6f5e540 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:04:11.740648 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-901b0f8d-baae-458a-8d8f-b4e5e6f5e540 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] [instance: d29e3483-56d1-40fb-a15f-5a57da6e5475] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:04:11.747064 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-901b0f8d-baae-458a-8d8f-b4e5e6f5e540 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:11.747558 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-901b0f8d-baae-458a-8d8f-b4e5e6f5e540 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:11.748316 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-901b0f8d-baae-458a-8d8f-b4e5e6f5e540 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:11.748751 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-901b0f8d-baae-458a-8d8f-b4e5e6f5e540 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:11.761813 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-901b0f8d-baae-458a-8d8f-b4e5e6f5e540 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] HTTP exception thrown: Instance d29e3483-56d1-40fb-a15f-5a57da6e5475 could not be found. Jun 17 09:04:11.763331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-901b0f8d-baae-458a-8d8f-b4e5e6f5e540 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Request method failure captured: Jun 17 09:04:11.763331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 HTTP/1.1 Jun 17 09:04:11.763331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 09:04:11.763331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 09:04:11.763331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 09:04:11.763331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 09:04:11.763331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 09:04:11.763331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 09:04:11.763331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 09:04:11.763331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 09:04:11.763331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirEKD1DEWRZVRUveV5UEZzucfNrYDHwPR19E9HSeuTAJvYtv-tRMSey7zis4DE7QWyLY9sP3u8vZ9YZaCir2zfM9yx-3yfXT3ZzT7BhAc5PMkJx1scolSO_aoqUUnCeRoZHDslCqc1M2LaLnuzVzGAXFKThgGs8lzrOZKQDGy1Ael5Rk Jun 17 09:04:11.763331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 09:04:11.763331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 09:04:11.763331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 09:04:11.763331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 09:04:11.763331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 09:04:11.763331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 09:04:11.763331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: f0964a125c554efe858f7695016de8db Jun 17 09:04:11.763331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-AttachVolumeTestJSON-1223322254 Jun 17 09:04:11.763331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 09:04:11.763331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 09:04:11.764972 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f0964a125c554efe858f7695016de8db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f0964a125c554efe858f7695016de8db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f0964a125c554efe858f7695016de8db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f0964a125c554efe858f7695016de8db"}]}] Jun 17 09:04:11.764972 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-AttachVolumeTestJSON-1223322254 Jun 17 09:04:11.764972 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: f0964a125c554efe858f7695016de8db Jun 17 09:04:11.764972 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1223322254 Jun 17 09:04:11.764972 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-AttachVolumeTestJSON-1223322254-project Jun 17 09:04:11.764972 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 09:04:11.764972 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 09:04:11.764972 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: 449850e1f8d144eb8b330a764882a099 Jun 17 09:04:11.764972 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-AttachVolumeTestJSON-1223322254-project Jun 17 09:04:11.764972 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 09:04:11.764972 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Instance d29e3483-56d1-40fb-a15f-5a57da6e5475 could not be found. Jun 17 09:04:11.764972 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'id': 'd29e3483-56d1-40fb-a15f-5a57da6e5475'} Jun 17 09:04:11.766238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 09:04:11.766238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:04:11.766238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 09:04:11.766238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 09:04:11.766238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 09:04:11.766238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 09:04:11.766238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 09:04:11.766238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 09:04:11.766238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 09:04:11.766238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 09:04:11.766238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d29e3483-56d1-40fb-a15f-5a57da6e5475 could not be found. Jun 17 09:04:11.766238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:04:11.766238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:04:11.766238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:04:11.766238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:04:11.766238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:04:11.766238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:04:11.766238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 09:04:11.766238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 09:04:11.766238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 09:04:11.767737 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 09:04:11.767737 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 09:04:11.767737 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 09:04:11.767737 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 09:04:11.767737 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 09:04:11.767737 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 09:04:11.767737 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 09:04:11.767737 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d29e3483-56d1-40fb-a15f-5a57da6e5475 could not be found. Jun 17 09:04:11.767737 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:04:11.767737 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:04:11.767737 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:04:11.767737 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:04:11.767737 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:04:11.767737 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:04:11.767737 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 09:04:11.767737 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 09:04:11.767737 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d29e3483-56d1-40fb-a15f-5a57da6e5475 could not be found. Jun 17 09:04:11.767737 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:04:11.769147 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-901b0f8d-baae-458a-8d8f-b4e5e6f5e540 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] Returning 404 to user: Instance d29e3483-56d1-40fb-a15f-5a57da6e5475 could not be found. {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 09:04:11.769147 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-901b0f8d-baae-458a-8d8f-b4e5e6f5e540 tempest-AttachVolumeTestJSON-1223322254 tempest-AttachVolumeTestJSON-1223322254-project] 10.222.0.78 "GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475" status: 404 len: 111 microversion: 2.1 time: 0.028615 Jun 17 09:04:11.769147 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 598/1192] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:04:11 2022] GET /compute/v2.1/servers/d29e3483-56d1-40fb-a15f-5a57da6e5475 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 09:04:57.368231 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-27102faf-2ec3-4044-be34-7260ee64b61a tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:04:57.372841 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-27102faf-2ec3-4044-be34-7260ee64b61a tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 30f34aae-76cf-4423-b9c0-db2ce701d138] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:04:57.372983 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-727677e5-2762-48b6-b9a3-9a722ef66dfd req-013770df-245b-423c-84dc-09c834cc1450 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30f34aae-76cf-4423-b9c0-db2ce701d138", "tag": "5841a5dd-f021-4da9-a952-f77917f1048b"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:04:57.373421 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:04:57.373421 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:04:57.377200 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:04:57.377840 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:04:57.379599 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-27102faf-2ec3-4044-be34-7260ee64b61a tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:57.380289 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-27102faf-2ec3-4044-be34-7260ee64b61a tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:57.381168 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-27102faf-2ec3-4044-be34-7260ee64b61a tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:57.381911 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-27102faf-2ec3-4044-be34-7260ee64b61a tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:57.383129 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-727677e5-2762-48b6-b9a3-9a722ef66dfd req-013770df-245b-423c-84dc-09c834cc1450 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:57.383789 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-727677e5-2762-48b6-b9a3-9a722ef66dfd req-013770df-245b-423c-84dc-09c834cc1450 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:57.395672 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-727677e5-2762-48b6-b9a3-9a722ef66dfd req-013770df-245b-423c-84dc-09c834cc1450 service nova] Creating event network-changed:5841a5dd-f021-4da9-a952-f77917f1048b for instance 30f34aae-76cf-4423-b9c0-db2ce701d138 on hv-cinder-79760 Jun 17 09:04:57.400926 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-727677e5-2762-48b6-b9a3-9a722ef66dfd req-013770df-245b-423c-84dc-09c834cc1450 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034727 Jun 17 09:04:57.401527 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 599/1193] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 09:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 09:04:57.412185 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-27102faf-2ec3-4044-be34-7260ee64b61a tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 30f34aae-76cf-4423-b9c0-db2ce701d138] Going to try to terminate instance {{(pid=129875) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 09:04:57.842019 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-27102faf-2ec3-4044-be34-7260ee64b61a tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "DELETE /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138" status: 204 len: 0 microversion: 2.1 time: 0.477915 Jun 17 09:04:57.844429 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 595/1194] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 09:04:57 2022] DELETE /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 09:04:57.853413 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-fe11948e-2e74-48ad-b205-da7a7771aa4d tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:04:57.854608 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-fe11948e-2e74-48ad-b205-da7a7771aa4d tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 30f34aae-76cf-4423-b9c0-db2ce701d138] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:04:57.863178 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fe11948e-2e74-48ad-b205-da7a7771aa4d tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:57.864034 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fe11948e-2e74-48ad-b205-da7a7771aa4d tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:57.864929 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fe11948e-2e74-48ad-b205-da7a7771aa4d tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:57.865615 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-fe11948e-2e74-48ad-b205-da7a7771aa4d tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:58.000641 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-fe11948e-2e74-48ad-b205-da7a7771aa4d tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:04:58.008352 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-fe11948e-2e74-48ad-b205-da7a7771aa4d tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138" status: 200 len: 1575 microversion: 2.1 time: 0.159621 Jun 17 09:04:58.008975 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 600/1195] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:04:57 2022] GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:04:59.026723 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-7d3e482a-5126-44d8-bb93-0897214cdd9f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:04:59.027463 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-7d3e482a-5126-44d8-bb93-0897214cdd9f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 30f34aae-76cf-4423-b9c0-db2ce701d138] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:04:59.035294 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7d3e482a-5126-44d8-bb93-0897214cdd9f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:59.035773 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7d3e482a-5126-44d8-bb93-0897214cdd9f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:59.036548 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7d3e482a-5126-44d8-bb93-0897214cdd9f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:59.036985 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7d3e482a-5126-44d8-bb93-0897214cdd9f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:59.190120 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-7d3e482a-5126-44d8-bb93-0897214cdd9f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:04:59.198081 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-7d3e482a-5126-44d8-bb93-0897214cdd9f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138" status: 200 len: 1456 microversion: 2.1 time: 0.175589 Jun 17 09:04:59.198674 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 596/1196] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:04:59 2022] GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138 => generated 1456 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:04:59.875668 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-ed68c118-6852-4b30-b400-8852b04b8c57 req-afa24d77-2398-4188-8c1a-d0f91cd87094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30f34aae-76cf-4423-b9c0-db2ce701d138", "name": "network-vif-deleted", "tag": "5841a5dd-f021-4da9-a952-f77917f1048b"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:04:59.885297 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-ed68c118-6852-4b30-b400-8852b04b8c57 req-afa24d77-2398-4188-8c1a-d0f91cd87094 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:04:59.887896 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-ed68c118-6852-4b30-b400-8852b04b8c57 req-afa24d77-2398-4188-8c1a-d0f91cd87094 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:04:59.897726 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-ed68c118-6852-4b30-b400-8852b04b8c57 req-afa24d77-2398-4188-8c1a-d0f91cd87094 service nova] Creating event network-vif-deleted:5841a5dd-f021-4da9-a952-f77917f1048b for instance 30f34aae-76cf-4423-b9c0-db2ce701d138 on hv-cinder-79760 Jun 17 09:04:59.902928 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-ed68c118-6852-4b30-b400-8852b04b8c57 req-afa24d77-2398-4188-8c1a-d0f91cd87094 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032350 Jun 17 09:04:59.903535 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 601/1197] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 09:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:05:00.218836 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1e8f67e2-2477-4e5c-80ce-c0fef12679c1 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:00.218836 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-1e8f67e2-2477-4e5c-80ce-c0fef12679c1 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 30f34aae-76cf-4423-b9c0-db2ce701d138] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:00.224202 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1e8f67e2-2477-4e5c-80ce-c0fef12679c1 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:00.224653 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1e8f67e2-2477-4e5c-80ce-c0fef12679c1 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:00.225489 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1e8f67e2-2477-4e5c-80ce-c0fef12679c1 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:00.225936 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1e8f67e2-2477-4e5c-80ce-c0fef12679c1 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:00.291854 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-1e8f67e2-2477-4e5c-80ce-c0fef12679c1 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:00.301463 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-1e8f67e2-2477-4e5c-80ce-c0fef12679c1 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138" status: 200 len: 1224 microversion: 2.1 time: 0.087510 Jun 17 09:05:00.301463 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 597/1198] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:00 2022] GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:01.319948 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-04483610-e57b-4ee4-8494-cb0fb8fe1b60 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:01.320908 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-04483610-e57b-4ee4-8494-cb0fb8fe1b60 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 30f34aae-76cf-4423-b9c0-db2ce701d138] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:01.330036 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-04483610-e57b-4ee4-8494-cb0fb8fe1b60 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:01.330717 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-04483610-e57b-4ee4-8494-cb0fb8fe1b60 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:01.331468 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-04483610-e57b-4ee4-8494-cb0fb8fe1b60 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:01.332117 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-04483610-e57b-4ee4-8494-cb0fb8fe1b60 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:01.375001 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-04483610-e57b-4ee4-8494-cb0fb8fe1b60 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:01.375001 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-04483610-e57b-4ee4-8494-cb0fb8fe1b60 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:01.375001 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.objects.instance [None req-04483610-e57b-4ee4-8494-cb0fb8fe1b60 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lazy-loading 'fault' on Instance uuid 30f34aae-76cf-4423-b9c0-db2ce701d138 {{(pid=129876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 09:05:01.416152 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-04483610-e57b-4ee4-8494-cb0fb8fe1b60 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:01.423507 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-04483610-e57b-4ee4-8494-cb0fb8fe1b60 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138" status: 200 len: 1183 microversion: 2.1 time: 0.109936 Jun 17 09:05:01.424120 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 602/1199] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:01 2022] GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138 => generated 1183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:02.444648 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-2255a36f-ba88-4407-842e-6d996cbe458f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:02.445253 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-2255a36f-ba88-4407-842e-6d996cbe458f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 30f34aae-76cf-4423-b9c0-db2ce701d138] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:02.451816 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2255a36f-ba88-4407-842e-6d996cbe458f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:02.452390 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2255a36f-ba88-4407-842e-6d996cbe458f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:02.453253 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2255a36f-ba88-4407-842e-6d996cbe458f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:02.453693 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2255a36f-ba88-4407-842e-6d996cbe458f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:02.466924 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-2255a36f-ba88-4407-842e-6d996cbe458f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] HTTP exception thrown: Instance 30f34aae-76cf-4423-b9c0-db2ce701d138 could not be found. Jun 17 09:05:02.469580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-2255a36f-ba88-4407-842e-6d996cbe458f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Request method failure captured: Jun 17 09:05:02.469580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138 HTTP/1.1 Jun 17 09:05:02.469580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 09:05:02.469580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 09:05:02.469580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 09:05:02.469580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 09:05:02.469580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 09:05:02.469580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 09:05:02.469580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 09:05:02.469580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 09:05:02.469580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirEIKeO2XlpueOmt6XV4Mtz0ie6WcoHM2o7AWarKz3Cxip9kkDwG5miXS13Hxb8JSviIVkZVKalJLXJBAXW93Ef4LYMhV5qo_ipE3U6Zo8_m-1JB3KGuklzg9e_KHPiOfgo1bWks8eSFC2tbJeBfn8snXM4zzZRr-odFoUOIqxw-3gwk Jun 17 09:05:02.469580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 09:05:02.469580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 09:05:02.469580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 09:05:02.469580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 09:05:02.469580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 09:05:02.469580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 09:05:02.469580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: 4c3ecf1efb8748a0af09e501e2b9d81b Jun 17 09:05:02.469580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-TestVolumeBootPattern-2115809400 Jun 17 09:05:02.469580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 09:05:02.469580 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 09:05:02.471258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4c3ecf1efb8748a0af09e501e2b9d81b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c3ecf1efb8748a0af09e501e2b9d81b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4c3ecf1efb8748a0af09e501e2b9d81b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c3ecf1efb8748a0af09e501e2b9d81b"}]}] Jun 17 09:05:02.471258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-TestVolumeBootPattern-2115809400 Jun 17 09:05:02.471258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: 4c3ecf1efb8748a0af09e501e2b9d81b Jun 17 09:05:02.471258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-TestVolumeBootPattern-2115809400 Jun 17 09:05:02.471258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-TestVolumeBootPattern-2115809400-project Jun 17 09:05:02.471258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 09:05:02.471258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 09:05:02.471258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: 61c06d41d371486c9856a17c5b2aee20 Jun 17 09:05:02.471258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-TestVolumeBootPattern-2115809400-project Jun 17 09:05:02.471258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: > Jun 17 09:05:02.471258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Instance 30f34aae-76cf-4423-b9c0-db2ce701d138 could not be found. Jun 17 09:05:02.471258 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'id': '30f34aae-76cf-4423-b9c0-db2ce701d138'} Jun 17 09:05:02.472303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 09:05:02.472303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:05:02.472303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 09:05:02.472303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 09:05:02.472303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 09:05:02.472303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 09:05:02.472303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 09:05:02.472303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 09:05:02.472303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 09:05:02.472303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 09:05:02.472303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30f34aae-76cf-4423-b9c0-db2ce701d138 could not be found. Jun 17 09:05:02.472303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:05:02.472303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:05:02.472303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:05:02.472303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:05:02.472303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:05:02.472303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:05:02.472303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 09:05:02.472303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 09:05:02.472303 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 09:05:02.474147 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 09:05:02.474147 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 09:05:02.474147 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 09:05:02.474147 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 09:05:02.474147 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 09:05:02.474147 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 09:05:02.474147 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 09:05:02.474147 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30f34aae-76cf-4423-b9c0-db2ce701d138 could not be found. Jun 17 09:05:02.474147 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:05:02.474147 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:05:02.474147 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:05:02.474147 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:05:02.474147 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:05:02.474147 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:05:02.474147 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 09:05:02.474147 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 09:05:02.474147 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30f34aae-76cf-4423-b9c0-db2ce701d138 could not be found. Jun 17 09:05:02.474147 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:05:02.475651 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-2255a36f-ba88-4407-842e-6d996cbe458f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Returning 404 to user: Instance 30f34aae-76cf-4423-b9c0-db2ce701d138 could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 09:05:02.475651 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-2255a36f-ba88-4407-842e-6d996cbe458f tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138" status: 404 len: 111 microversion: 2.1 time: 0.029531 Jun 17 09:05:02.475651 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 598/1200] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:02 2022] GET /compute/v2.1/servers/30f34aae-76cf-4423-b9c0-db2ce701d138 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 09:05:06.224023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-6802e620-e8d2-426a-8822-01df522cadfb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:06.224023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-6802e620-e8d2-426a-8822-01df522cadfb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: cfdb821c-9155-4446-a423-8e8ddddc0902] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:06.230050 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6802e620-e8d2-426a-8822-01df522cadfb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:06.230734 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6802e620-e8d2-426a-8822-01df522cadfb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:06.231379 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-a9128da3-e83e-4496-9533-b3f202989491 req-70312d8a-821b-4974-9550-30b1706f5360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfdb821c-9155-4446-a423-8e8ddddc0902", "tag": "b4cd31ab-2201-4188-9f14-62d62fa9247e"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:05:06.233861 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6802e620-e8d2-426a-8822-01df522cadfb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:06.234662 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6802e620-e8d2-426a-8822-01df522cadfb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:06.240938 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-a9128da3-e83e-4496-9533-b3f202989491 req-70312d8a-821b-4974-9550-30b1706f5360 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:06.241388 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-a9128da3-e83e-4496-9533-b3f202989491 req-70312d8a-821b-4974-9550-30b1706f5360 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:06.253733 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-a9128da3-e83e-4496-9533-b3f202989491 req-70312d8a-821b-4974-9550-30b1706f5360 service nova] Creating event network-changed:b4cd31ab-2201-4188-9f14-62d62fa9247e for instance cfdb821c-9155-4446-a423-8e8ddddc0902 on hv-cinder-79760 Jun 17 09:05:06.259068 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-a9128da3-e83e-4496-9533-b3f202989491 req-70312d8a-821b-4974-9550-30b1706f5360 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031467 Jun 17 09:05:06.259764 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 599/1201] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 09:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 09:05:06.268246 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-6802e620-e8d2-426a-8822-01df522cadfb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: cfdb821c-9155-4446-a423-8e8ddddc0902] Going to try to terminate instance {{(pid=129876) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 09:05:06.583142 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-6802e620-e8d2-426a-8822-01df522cadfb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "DELETE /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902" status: 204 len: 0 microversion: 2.1 time: 0.367779 Jun 17 09:05:06.584321 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 603/1202] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 09:05:06 2022] DELETE /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 09:05:06.593722 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-99c2a216-7fa7-4c13-a2cd-a618eb0a7ae6 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:06.594592 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-99c2a216-7fa7-4c13-a2cd-a618eb0a7ae6 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: cfdb821c-9155-4446-a423-8e8ddddc0902] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:06.601525 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-99c2a216-7fa7-4c13-a2cd-a618eb0a7ae6 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:06.602283 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-99c2a216-7fa7-4c13-a2cd-a618eb0a7ae6 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:06.603456 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-99c2a216-7fa7-4c13-a2cd-a618eb0a7ae6 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:06.604058 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-99c2a216-7fa7-4c13-a2cd-a618eb0a7ae6 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:06.747503 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-99c2a216-7fa7-4c13-a2cd-a618eb0a7ae6 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:06.758916 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-99c2a216-7fa7-4c13-a2cd-a618eb0a7ae6 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902" status: 200 len: 1575 microversion: 2.1 time: 0.169703 Jun 17 09:05:06.759653 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 600/1203] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:06 2022] GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:07.778124 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-d6ff07b8-bfa3-494e-befa-2e9fd6dd3e1c tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:07.778826 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-d6ff07b8-bfa3-494e-befa-2e9fd6dd3e1c tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: cfdb821c-9155-4446-a423-8e8ddddc0902] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:07.786826 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d6ff07b8-bfa3-494e-befa-2e9fd6dd3e1c tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:07.787272 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d6ff07b8-bfa3-494e-befa-2e9fd6dd3e1c tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:07.788075 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d6ff07b8-bfa3-494e-befa-2e9fd6dd3e1c tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:07.788729 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d6ff07b8-bfa3-494e-befa-2e9fd6dd3e1c tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:07.944147 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-d6ff07b8-bfa3-494e-befa-2e9fd6dd3e1c tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:07.951752 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-d6ff07b8-bfa3-494e-befa-2e9fd6dd3e1c tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902" status: 200 len: 1575 microversion: 2.1 time: 0.178108 Jun 17 09:05:07.952322 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 604/1204] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:07 2022] GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902 => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:08.755617 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-728ee105-fbfd-4846-9e56-b0969098dae9 req-26cf681d-cda7-46ba-92e9-7dd5bdd23afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfdb821c-9155-4446-a423-8e8ddddc0902", "name": "network-vif-deleted", "tag": "b4cd31ab-2201-4188-9f14-62d62fa9247e"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:05:08.765296 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-728ee105-fbfd-4846-9e56-b0969098dae9 req-26cf681d-cda7-46ba-92e9-7dd5bdd23afd service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:08.769192 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-728ee105-fbfd-4846-9e56-b0969098dae9 req-26cf681d-cda7-46ba-92e9-7dd5bdd23afd service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:08.776926 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-728ee105-fbfd-4846-9e56-b0969098dae9 req-26cf681d-cda7-46ba-92e9-7dd5bdd23afd service nova] Creating event network-vif-deleted:b4cd31ab-2201-4188-9f14-62d62fa9247e for instance cfdb821c-9155-4446-a423-8e8ddddc0902 on hv-cinder-79760 Jun 17 09:05:08.782395 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-728ee105-fbfd-4846-9e56-b0969098dae9 req-26cf681d-cda7-46ba-92e9-7dd5bdd23afd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030416 Jun 17 09:05:08.783067 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 601/1205] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 09:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:05:08.968783 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-bd4d2270-f862-48f4-8a33-2dafa0e42c5b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:08.969364 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-bd4d2270-f862-48f4-8a33-2dafa0e42c5b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: cfdb821c-9155-4446-a423-8e8ddddc0902] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:08.975318 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bd4d2270-f862-48f4-8a33-2dafa0e42c5b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:08.975855 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bd4d2270-f862-48f4-8a33-2dafa0e42c5b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:08.976619 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bd4d2270-f862-48f4-8a33-2dafa0e42c5b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:08.977079 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-bd4d2270-f862-48f4-8a33-2dafa0e42c5b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:09.039824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-bd4d2270-f862-48f4-8a33-2dafa0e42c5b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c06d41d371486c9856a17c5b2aee20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3ecf1efb8748a0af09e501e2b9d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:09.049400 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-bd4d2270-f862-48f4-8a33-2dafa0e42c5b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902" status: 200 len: 1225 microversion: 2.1 time: 0.084856 Jun 17 09:05:09.058749 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 605/1206] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:08 2022] GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:10.067475 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d6a821b3-00bc-41c8-916c-1f8b94078e62 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:10.068123 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-d6a821b3-00bc-41c8-916c-1f8b94078e62 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: cfdb821c-9155-4446-a423-8e8ddddc0902] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:10.074412 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d6a821b3-00bc-41c8-916c-1f8b94078e62 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:10.074865 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d6a821b3-00bc-41c8-916c-1f8b94078e62 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:10.075672 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d6a821b3-00bc-41c8-916c-1f8b94078e62 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:10.076118 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-d6a821b3-00bc-41c8-916c-1f8b94078e62 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:10.089360 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-d6a821b3-00bc-41c8-916c-1f8b94078e62 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] HTTP exception thrown: Instance cfdb821c-9155-4446-a423-8e8ddddc0902 could not be found. Jun 17 09:05:10.090961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d6a821b3-00bc-41c8-916c-1f8b94078e62 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Request method failure captured: Jun 17 09:05:10.090961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902 HTTP/1.1 Jun 17 09:05:10.090961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 09:05:10.090961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 09:05:10.090961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 09:05:10.090961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 09:05:10.090961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 09:05:10.090961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 09:05:10.090961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 09:05:10.090961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 09:05:10.090961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirEIKeO2XlpueOmt6XV4Mtz0ie6WcoHM2o7AWarKz3Cxip9kkDwG5miXS13Hxb8JSviIVkZVKalJLXJBAXW93Ef4LYMhV5qo_ipE3U6Zo8_m-1JB3KGuklzg9e_KHPiOfgo1bWks8eSFC2tbJeBfn8snXM4zzZRr-odFoUOIqxw-3gwk Jun 17 09:05:10.090961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 09:05:10.090961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 09:05:10.090961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 09:05:10.090961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 09:05:10.090961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 09:05:10.090961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 09:05:10.090961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: 4c3ecf1efb8748a0af09e501e2b9d81b Jun 17 09:05:10.090961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-TestVolumeBootPattern-2115809400 Jun 17 09:05:10.090961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 09:05:10.090961 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 09:05:10.095964 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4c3ecf1efb8748a0af09e501e2b9d81b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c3ecf1efb8748a0af09e501e2b9d81b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4c3ecf1efb8748a0af09e501e2b9d81b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c3ecf1efb8748a0af09e501e2b9d81b"}]}] Jun 17 09:05:10.095964 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-TestVolumeBootPattern-2115809400 Jun 17 09:05:10.095964 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: 4c3ecf1efb8748a0af09e501e2b9d81b Jun 17 09:05:10.095964 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-TestVolumeBootPattern-2115809400 Jun 17 09:05:10.095964 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-TestVolumeBootPattern-2115809400-project Jun 17 09:05:10.095964 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 09:05:10.095964 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 09:05:10.095964 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: 61c06d41d371486c9856a17c5b2aee20 Jun 17 09:05:10.095964 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-TestVolumeBootPattern-2115809400-project Jun 17 09:05:10.095964 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: > Jun 17 09:05:10.095964 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Instance cfdb821c-9155-4446-a423-8e8ddddc0902 could not be found. Jun 17 09:05:10.095964 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'id': 'cfdb821c-9155-4446-a423-8e8ddddc0902'} Jun 17 09:05:10.096889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 09:05:10.096889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:05:10.096889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 09:05:10.096889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 09:05:10.096889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 09:05:10.096889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 09:05:10.096889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 09:05:10.096889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 09:05:10.096889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 09:05:10.096889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 09:05:10.096889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfdb821c-9155-4446-a423-8e8ddddc0902 could not be found. Jun 17 09:05:10.096889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:05:10.096889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:05:10.096889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:05:10.096889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:05:10.096889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:05:10.096889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:05:10.096889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 09:05:10.096889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 09:05:10.096889 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 09:05:10.098380 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 09:05:10.098380 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 09:05:10.098380 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 09:05:10.098380 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 09:05:10.098380 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 09:05:10.098380 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 09:05:10.098380 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 09:05:10.098380 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfdb821c-9155-4446-a423-8e8ddddc0902 could not be found. Jun 17 09:05:10.098380 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:05:10.098380 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:05:10.098380 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:05:10.098380 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:05:10.098380 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:05:10.098380 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:05:10.098380 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 09:05:10.098380 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 09:05:10.098380 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfdb821c-9155-4446-a423-8e8ddddc0902 could not be found. Jun 17 09:05:10.098380 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:05:10.100363 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-d6a821b3-00bc-41c8-916c-1f8b94078e62 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Returning 404 to user: Instance cfdb821c-9155-4446-a423-8e8ddddc0902 could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 09:05:10.100363 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-d6a821b3-00bc-41c8-916c-1f8b94078e62 tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902" status: 404 len: 111 microversion: 2.1 time: 0.029938 Jun 17 09:05:10.100363 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 602/1207] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:10 2022] GET /compute/v2.1/servers/cfdb821c-9155-4446-a423-8e8ddddc0902 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 09:05:10.629041 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-1761d4f2-d66f-4973-8fb4-07d523418c4e tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:10.629549 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-1761d4f2-d66f-4973-8fb4-07d523418c4e tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:10.636118 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1761d4f2-d66f-4973-8fb4-07d523418c4e tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:10.644263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1761d4f2-d66f-4973-8fb4-07d523418c4e tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:10.644263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1761d4f2-d66f-4973-8fb4-07d523418c4e tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:10.644263 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-1761d4f2-d66f-4973-8fb4-07d523418c4e tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:10.651797 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-1761d4f2-d66f-4973-8fb4-07d523418c4e tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] HTTP exception thrown: Instance 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a could not be found. Jun 17 09:05:10.653454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-1761d4f2-d66f-4973-8fb4-07d523418c4e tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Request method failure captured: Jun 17 09:05:10.653454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: DELETE /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a HTTP/1.1 Jun 17 09:05:10.653454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 09:05:10.653454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 09:05:10.653454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 09:05:10.653454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 09:05:10.653454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 09:05:10.653454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 09:05:10.653454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 09:05:10.653454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 09:05:10.653454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirEIKeO2XlpueOmt6XV4Mtz0ie6WcoHM2o7AWarKz3Cxip9kkDwG5miXS13Hxb8JSviIVkZVKalJLXJBAXW93Ef4LYMhV5qo_ipE3U6Zo8_m-1JB3KGuklzg9e_KHPiOfgo1bWks8eSFC2tbJeBfn8snXM4zzZRr-odFoUOIqxw-3gwk Jun 17 09:05:10.653454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 09:05:10.653454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 09:05:10.653454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 09:05:10.653454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 09:05:10.653454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 09:05:10.653454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 09:05:10.653454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: 4c3ecf1efb8748a0af09e501e2b9d81b Jun 17 09:05:10.653454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-TestVolumeBootPattern-2115809400 Jun 17 09:05:10.653454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 09:05:10.653454 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 09:05:10.655824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4c3ecf1efb8748a0af09e501e2b9d81b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c3ecf1efb8748a0af09e501e2b9d81b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4c3ecf1efb8748a0af09e501e2b9d81b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c3ecf1efb8748a0af09e501e2b9d81b"}]}] Jun 17 09:05:10.655824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-TestVolumeBootPattern-2115809400 Jun 17 09:05:10.655824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: 4c3ecf1efb8748a0af09e501e2b9d81b Jun 17 09:05:10.655824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-TestVolumeBootPattern-2115809400 Jun 17 09:05:10.655824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-TestVolumeBootPattern-2115809400-project Jun 17 09:05:10.655824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 09:05:10.655824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 09:05:10.655824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: 61c06d41d371486c9856a17c5b2aee20 Jun 17 09:05:10.655824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-TestVolumeBootPattern-2115809400-project Jun 17 09:05:10.655824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 09:05:10.655824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Instance 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a could not be found. Jun 17 09:05:10.655824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'id': '7ba9b8cb-042a-41e7-a0bf-2f511d8a685a'} Jun 17 09:05:10.656889 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 09:05:10.656889 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:05:10.656889 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 09:05:10.656889 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 09:05:10.656889 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 09:05:10.656889 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 09:05:10.656889 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 09:05:10.656889 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 09:05:10.656889 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 09:05:10.656889 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 09:05:10.656889 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a could not be found. Jun 17 09:05:10.656889 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:05:10.656889 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:05:10.656889 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:05:10.656889 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:05:10.656889 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:05:10.656889 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:05:10.656889 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 09:05:10.656889 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 09:05:10.656889 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 09:05:10.658524 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 09:05:10.658524 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 09:05:10.658524 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 09:05:10.658524 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 09:05:10.658524 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 09:05:10.658524 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 09:05:10.658524 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 09:05:10.658524 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 09:05:10.658524 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 09:05:10.658524 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a could not be found. Jun 17 09:05:10.658524 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:05:10.658524 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:05:10.658524 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:05:10.658524 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:05:10.658524 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:05:10.658524 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:05:10.658524 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 09:05:10.658524 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 09:05:10.658524 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a could not be found. Jun 17 09:05:10.658524 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:05:10.660246 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-1761d4f2-d66f-4973-8fb4-07d523418c4e tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Returning 404 to user: Instance 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a could not be found. {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 09:05:10.660246 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-1761d4f2-d66f-4973-8fb4-07d523418c4e tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 404 len: 111 microversion: 2.1 time: 0.029852 Jun 17 09:05:10.660246 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 606/1208] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 09:05:10 2022] DELETE /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 09:05:10.664089 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1def5185-7317-4ae9-818d-f09394fe0d8b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:10.664724 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-1def5185-7317-4ae9-818d-f09394fe0d8b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] [instance: 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:10.670785 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1def5185-7317-4ae9-818d-f09394fe0d8b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:10.671208 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1def5185-7317-4ae9-818d-f09394fe0d8b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:10.671993 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1def5185-7317-4ae9-818d-f09394fe0d8b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:10.672425 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-1def5185-7317-4ae9-818d-f09394fe0d8b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:10.686392 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-1def5185-7317-4ae9-818d-f09394fe0d8b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] HTTP exception thrown: Instance 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a could not be found. Jun 17 09:05:10.687927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1def5185-7317-4ae9-818d-f09394fe0d8b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Request method failure captured: Jun 17 09:05:10.687927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a HTTP/1.1 Jun 17 09:05:10.687927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 09:05:10.687927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 09:05:10.687927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 09:05:10.687927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 09:05:10.687927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 09:05:10.687927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 09:05:10.687927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 09:05:10.687927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 09:05:10.687927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirEIKeO2XlpueOmt6XV4Mtz0ie6WcoHM2o7AWarKz3Cxip9kkDwG5miXS13Hxb8JSviIVkZVKalJLXJBAXW93Ef4LYMhV5qo_ipE3U6Zo8_m-1JB3KGuklzg9e_KHPiOfgo1bWks8eSFC2tbJeBfn8snXM4zzZRr-odFoUOIqxw-3gwk Jun 17 09:05:10.687927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 09:05:10.687927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 09:05:10.687927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 09:05:10.687927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 09:05:10.687927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 09:05:10.687927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 09:05:10.687927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: 4c3ecf1efb8748a0af09e501e2b9d81b Jun 17 09:05:10.687927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-TestVolumeBootPattern-2115809400 Jun 17 09:05:10.687927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 09:05:10.687927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 09:05:10.689562 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4c3ecf1efb8748a0af09e501e2b9d81b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c3ecf1efb8748a0af09e501e2b9d81b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4c3ecf1efb8748a0af09e501e2b9d81b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c3ecf1efb8748a0af09e501e2b9d81b"}]}] Jun 17 09:05:10.689562 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-TestVolumeBootPattern-2115809400 Jun 17 09:05:10.689562 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: 4c3ecf1efb8748a0af09e501e2b9d81b Jun 17 09:05:10.689562 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-TestVolumeBootPattern-2115809400 Jun 17 09:05:10.689562 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-TestVolumeBootPattern-2115809400-project Jun 17 09:05:10.689562 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 09:05:10.689562 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 09:05:10.689562 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: 61c06d41d371486c9856a17c5b2aee20 Jun 17 09:05:10.689562 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-TestVolumeBootPattern-2115809400-project Jun 17 09:05:10.689562 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: > Jun 17 09:05:10.689562 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Instance 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a could not be found. Jun 17 09:05:10.689562 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'id': '7ba9b8cb-042a-41e7-a0bf-2f511d8a685a'} Jun 17 09:05:10.690367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 09:05:10.690367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:05:10.690367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 09:05:10.690367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 09:05:10.690367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 09:05:10.690367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 09:05:10.690367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 09:05:10.690367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 09:05:10.690367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 09:05:10.690367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 09:05:10.690367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a could not be found. Jun 17 09:05:10.690367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:05:10.690367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:05:10.690367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:05:10.690367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:05:10.690367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:05:10.690367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:05:10.690367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 09:05:10.690367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 09:05:10.690367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 09:05:10.691699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 09:05:10.691699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 09:05:10.691699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 09:05:10.691699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 09:05:10.691699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 09:05:10.691699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 09:05:10.691699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 09:05:10.691699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a could not be found. Jun 17 09:05:10.691699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:05:10.691699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:05:10.691699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:05:10.691699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:05:10.691699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:05:10.691699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:05:10.691699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 09:05:10.691699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 09:05:10.691699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a could not be found. Jun 17 09:05:10.691699 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:05:10.692832 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-1def5185-7317-4ae9-818d-f09394fe0d8b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Returning 404 to user: Instance 7ba9b8cb-042a-41e7-a0bf-2f511d8a685a could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 09:05:10.692832 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-1def5185-7317-4ae9-818d-f09394fe0d8b tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a" status: 404 len: 111 microversion: 2.1 time: 0.029069 Jun 17 09:05:10.692832 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 603/1209] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:10 2022] GET /compute/v2.1/servers/7ba9b8cb-042a-41e7-a0bf-2f511d8a685a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 09:05:10.797964 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-6b932cda-e097-40a6-873b-eca716d86cf5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-139802883", "imageRef": "978084c7-ed2c-4e42-ac8b-f5d19c4001fe", "flavorRef": "452", "networks": [{"uuid": "18ce522e-401c-4f75-aa04-b101cb609c9f"}]}} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:05:10.852749 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.network.neutron [None req-6b932cda-e097-40a6-873b-eca716d86cf5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] validate_networks() for [('18ce522e-401c-4f75-aa04-b101cb609c9f', None, None, None, None, None)] {{(pid=129876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 09:05:11.257950 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-6b932cda-e097-40a6-873b-eca716d86cf5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Flavor limits 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 09:05:11.258386 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-6b932cda-e097-40a6-873b-eca716d86cf5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Image limits 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 09:05:11.258865 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-6b932cda-e097-40a6-873b-eca716d86cf5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Flavor pref 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 09:05:11.259282 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-6b932cda-e097-40a6-873b-eca716d86cf5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Image pref 0:0:0 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 09:05:11.259759 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.virt.hardware [None req-6b932cda-e097-40a6-873b-eca716d86cf5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 09:05:11.268703 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6b932cda-e097-40a6-873b-eca716d86cf5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:11.269505 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6b932cda-e097-40a6-873b-eca716d86cf5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:11.269940 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6b932cda-e097-40a6-873b-eca716d86cf5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:11.270378 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-6b932cda-e097-40a6-873b-eca716d86cf5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:11.286799 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-6b932cda-e097-40a6-873b-eca716d86cf5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Getting quotas for project a3661c95e2114a67b40bff418d2f0a3f. Resources: {'ram', 'cores', 'instances'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 09:05:11.290849 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.quota [None req-6b932cda-e097-40a6-873b-eca716d86cf5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Getting quotas for user efd3c64044394c619a37764e64dff4a2 and project a3661c95e2114a67b40bff418d2f0a3f. Resources: {'ram', 'cores', 'instances'} {{(pid=129876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 09:05:11.302239 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-6b932cda-e097-40a6-873b-eca716d86cf5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Going to run 1 instances... {{(pid=129876) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 09:05:11.304790 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-6b932cda-e097-40a6-873b-eca716d86cf5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: 6e9ef870-363e-4886-9445-96ce8444b819] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='978084c7-ed2c-4e42-ac8b-f5d19c4001fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 09:05:11.461623 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-6b932cda-e097-40a6-873b-eca716d86cf5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.667405 Jun 17 09:05:11.462273 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 607/1210] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jun 17 09:05:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 09:05:11.472531 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-108fd76c-7d60-405a-855b-1cb0cd5fbc7e tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:11.473262 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-108fd76c-7d60-405a-855b-1cb0cd5fbc7e tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: 6e9ef870-363e-4886-9445-96ce8444b819] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:11.538031 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-108fd76c-7d60-405a-855b-1cb0cd5fbc7e tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:11.544953 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-108fd76c-7d60-405a-855b-1cb0cd5fbc7e tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819" status: 200 len: 1213 microversion: 2.1 time: 0.076260 Jun 17 09:05:11.546190 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 604/1211] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:11 2022] GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819 => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:12.318186 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-5de23b83-980f-4979-af8e-8c86598981cb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] Calling method '.version_select at 0x7fbc33d394c0>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:12.418385 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-5de23b83-980f-4979-af8e-8c86598981cb tempest-TestVolumeBootPattern-2115809400 tempest-TestVolumeBootPattern-2115809400-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-899283893" status: 202 len: 0 microversion: 2.1 time: 0.107958 Jun 17 09:05:12.418965 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 608/1212] 10.222.0.78 () {58 vars in 1259 bytes} [Fri Jun 17 09:05:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-899283893 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 09:05:12.563685 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-fc1938b9-36ec-41fa-9900-ba33a8c3b4e0 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:12.564556 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-fc1938b9-36ec-41fa-9900-ba33a8c3b4e0 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: 6e9ef870-363e-4886-9445-96ce8444b819] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:12.632442 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-fc1938b9-36ec-41fa-9900-ba33a8c3b4e0 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:12.639483 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-fc1938b9-36ec-41fa-9900-ba33a8c3b4e0 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819" status: 200 len: 1213 microversion: 2.1 time: 0.080206 Jun 17 09:05:12.640071 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 605/1213] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:12 2022] GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:13.657455 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-56e71784-da18-40e7-bdbd-07d16a688e18 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:13.658680 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-56e71784-da18-40e7-bdbd-07d16a688e18 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: 6e9ef870-363e-4886-9445-96ce8444b819] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:13.666331 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-56e71784-da18-40e7-bdbd-07d16a688e18 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:13.666780 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-56e71784-da18-40e7-bdbd-07d16a688e18 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:13.668289 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-56e71784-da18-40e7-bdbd-07d16a688e18 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:13.668692 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-56e71784-da18-40e7-bdbd-07d16a688e18 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:13.742872 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-56e71784-da18-40e7-bdbd-07d16a688e18 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:13.752005 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-56e71784-da18-40e7-bdbd-07d16a688e18 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819" status: 200 len: 1265 microversion: 2.1 time: 0.099493 Jun 17 09:05:13.752600 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 609/1214] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:13 2022] GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819 => generated 1265 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:14.769275 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-19d973f2-f3db-4ca4-ba6e-eaf060b70724 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:14.770388 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-19d973f2-f3db-4ca4-ba6e-eaf060b70724 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: 6e9ef870-363e-4886-9445-96ce8444b819] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:14.777230 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-19d973f2-f3db-4ca4-ba6e-eaf060b70724 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:14.777808 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-19d973f2-f3db-4ca4-ba6e-eaf060b70724 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:14.778670 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-19d973f2-f3db-4ca4-ba6e-eaf060b70724 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:14.779379 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-19d973f2-f3db-4ca4-ba6e-eaf060b70724 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:14.850379 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-19d973f2-f3db-4ca4-ba6e-eaf060b70724 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:14.863482 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-19d973f2-f3db-4ca4-ba6e-eaf060b70724 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819" status: 200 len: 1271 microversion: 2.1 time: 0.098091 Jun 17 09:05:14.864731 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 606/1215] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:14 2022] GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819 => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:15.881364 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-cdb29fe8-e3e7-4344-9d0d-51d1b5579839 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:15.882705 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-cdb29fe8-e3e7-4344-9d0d-51d1b5579839 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: 6e9ef870-363e-4886-9445-96ce8444b819] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:15.890507 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-cdb29fe8-e3e7-4344-9d0d-51d1b5579839 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:15.891108 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-cdb29fe8-e3e7-4344-9d0d-51d1b5579839 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:15.893128 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-cdb29fe8-e3e7-4344-9d0d-51d1b5579839 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:15.893569 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-cdb29fe8-e3e7-4344-9d0d-51d1b5579839 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:16.038504 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-cdb29fe8-e3e7-4344-9d0d-51d1b5579839 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:16.047367 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-cdb29fe8-e3e7-4344-9d0d-51d1b5579839 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819" status: 200 len: 1313 microversion: 2.1 time: 0.169988 Jun 17 09:05:16.057381 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 610/1216] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:15 2022] GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:16.625946 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-e484fcbf-d72f-4820-a04c-34259bb73efe req-ae655959-7620-4a75-88da-983405ca4a16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e9ef870-363e-4886-9445-96ce8444b819", "tag": "a6aee089-810c-4274-a9c4-5174509375b2"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:05:16.647219 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-e484fcbf-d72f-4820-a04c-34259bb73efe req-ae655959-7620-4a75-88da-983405ca4a16 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:16.647679 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-e484fcbf-d72f-4820-a04c-34259bb73efe req-ae655959-7620-4a75-88da-983405ca4a16 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:16.672907 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-e484fcbf-d72f-4820-a04c-34259bb73efe req-ae655959-7620-4a75-88da-983405ca4a16 service nova] Creating event network-changed:a6aee089-810c-4274-a9c4-5174509375b2 for instance 6e9ef870-363e-4886-9445-96ce8444b819 on hv-cinder-79760 Jun 17 09:05:16.678173 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-e484fcbf-d72f-4820-a04c-34259bb73efe req-ae655959-7620-4a75-88da-983405ca4a16 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059340 Jun 17 09:05:16.679148 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 607/1217] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 09:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:05:17.065587 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-cfea041a-bc9b-4616-8e80-70f9d730e679 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:17.066242 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-cfea041a-bc9b-4616-8e80-70f9d730e679 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: 6e9ef870-363e-4886-9445-96ce8444b819] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:17.081836 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-cfea041a-bc9b-4616-8e80-70f9d730e679 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:17.082343 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-cfea041a-bc9b-4616-8e80-70f9d730e679 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:17.083138 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-cfea041a-bc9b-4616-8e80-70f9d730e679 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:17.089712 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-cfea041a-bc9b-4616-8e80-70f9d730e679 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:17.259412 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-cfea041a-bc9b-4616-8e80-70f9d730e679 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:17.267820 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-cfea041a-bc9b-4616-8e80-70f9d730e679 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819" status: 200 len: 1313 microversion: 2.1 time: 0.206859 Jun 17 09:05:17.268444 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 611/1218] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:17 2022] GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:18.285454 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-9606fa49-a67a-428a-8c9b-2d9afdcccc87 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:18.286163 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-9606fa49-a67a-428a-8c9b-2d9afdcccc87 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: 6e9ef870-363e-4886-9445-96ce8444b819] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:18.293155 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9606fa49-a67a-428a-8c9b-2d9afdcccc87 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:18.295550 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9606fa49-a67a-428a-8c9b-2d9afdcccc87 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:18.295550 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9606fa49-a67a-428a-8c9b-2d9afdcccc87 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:18.296041 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-9606fa49-a67a-428a-8c9b-2d9afdcccc87 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:18.464189 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-9606fa49-a67a-428a-8c9b-2d9afdcccc87 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:18.472273 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-9606fa49-a67a-428a-8c9b-2d9afdcccc87 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819" status: 200 len: 1313 microversion: 2.1 time: 0.190815 Jun 17 09:05:18.473204 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 608/1219] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:18 2022] GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:19.492717 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-8d44f714-c61b-4ef7-be35-2e4a56e51b1c tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:19.494141 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-8d44f714-c61b-4ef7-be35-2e4a56e51b1c tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: 6e9ef870-363e-4886-9445-96ce8444b819] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:19.501352 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8d44f714-c61b-4ef7-be35-2e4a56e51b1c tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:19.502155 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8d44f714-c61b-4ef7-be35-2e4a56e51b1c tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:19.502940 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8d44f714-c61b-4ef7-be35-2e4a56e51b1c tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:19.503406 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8d44f714-c61b-4ef7-be35-2e4a56e51b1c tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:19.649626 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-8d44f714-c61b-4ef7-be35-2e4a56e51b1c tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:19.660212 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-8d44f714-c61b-4ef7-be35-2e4a56e51b1c tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819" status: 200 len: 1313 microversion: 2.1 time: 0.173113 Jun 17 09:05:19.671222 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 612/1220] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:19 2022] GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:20.681988 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-ca0640ab-e81f-4e72-acf4-7068b2e6da18 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:20.682828 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-ca0640ab-e81f-4e72-acf4-7068b2e6da18 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: 6e9ef870-363e-4886-9445-96ce8444b819] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:20.689686 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ca0640ab-e81f-4e72-acf4-7068b2e6da18 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:20.690138 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ca0640ab-e81f-4e72-acf4-7068b2e6da18 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:20.690911 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ca0640ab-e81f-4e72-acf4-7068b2e6da18 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:20.691622 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-ca0640ab-e81f-4e72-acf4-7068b2e6da18 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:20.890349 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-ca0640ab-e81f-4e72-acf4-7068b2e6da18 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:20.897964 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-ca0640ab-e81f-4e72-acf4-7068b2e6da18 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819" status: 200 len: 1313 microversion: 2.1 time: 0.224365 Jun 17 09:05:20.898541 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 609/1221] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:20 2022] GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:21.176034 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-1da06749-02d4-43b8-ad22-718b61dfbafb req-a9bfdb85-062b-4e63-a7ce-b79ae5a7b735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e9ef870-363e-4886-9445-96ce8444b819", "name": "network-vif-plugged", "status": "completed", "tag": "a6aee089-810c-4274-a9c4-5174509375b2"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:05:21.185541 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-1da06749-02d4-43b8-ad22-718b61dfbafb req-a9bfdb85-062b-4e63-a7ce-b79ae5a7b735 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:21.188339 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-1da06749-02d4-43b8-ad22-718b61dfbafb req-a9bfdb85-062b-4e63-a7ce-b79ae5a7b735 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:21.199305 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-1da06749-02d4-43b8-ad22-718b61dfbafb req-a9bfdb85-062b-4e63-a7ce-b79ae5a7b735 service nova] Creating event network-vif-plugged:a6aee089-810c-4274-a9c4-5174509375b2 for instance 6e9ef870-363e-4886-9445-96ce8444b819 on hv-cinder-79760 Jun 17 09:05:21.204824 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-1da06749-02d4-43b8-ad22-718b61dfbafb req-a9bfdb85-062b-4e63-a7ce-b79ae5a7b735 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034343 Jun 17 09:05:21.205504 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 613/1222] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 09:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:05:21.915451 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-2ab24d14-380d-4785-b2da-3da33baedc52 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:21.916135 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-2ab24d14-380d-4785-b2da-3da33baedc52 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: 6e9ef870-363e-4886-9445-96ce8444b819] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:21.923071 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2ab24d14-380d-4785-b2da-3da33baedc52 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:21.923561 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2ab24d14-380d-4785-b2da-3da33baedc52 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:21.924340 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2ab24d14-380d-4785-b2da-3da33baedc52 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:21.924781 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-2ab24d14-380d-4785-b2da-3da33baedc52 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:22.076453 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-2ab24d14-380d-4785-b2da-3da33baedc52 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:22.084531 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-2ab24d14-380d-4785-b2da-3da33baedc52 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819" status: 200 len: 1313 microversion: 2.1 time: 0.173078 Jun 17 09:05:22.085102 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 610/1223] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:21 2022] GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:23.098475 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=2 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:05:23.099371 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=6 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:05:23.103797 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-0fce4c29-2fe7-4bff-9167-14d3c2df7ddf tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:23.104500 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-0fce4c29-2fe7-4bff-9167-14d3c2df7ddf tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: 6e9ef870-363e-4886-9445-96ce8444b819] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:23.111374 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0fce4c29-2fe7-4bff-9167-14d3c2df7ddf tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:23.111820 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0fce4c29-2fe7-4bff-9167-14d3c2df7ddf tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:23.112576 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0fce4c29-2fe7-4bff-9167-14d3c2df7ddf tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:23.113011 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0fce4c29-2fe7-4bff-9167-14d3c2df7ddf tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:23.252970 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-0fce4c29-2fe7-4bff-9167-14d3c2df7ddf tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:23.260412 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-0fce4c29-2fe7-4bff-9167-14d3c2df7ddf tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819" status: 200 len: 1497 microversion: 2.1 time: 0.162869 Jun 17 09:05:23.260979 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 614/1224] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:23 2022] GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819 => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:24.056927 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-869428da-f5a7-4f3d-ab38-1cbfffdef8bd tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:24.057511 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-869428da-f5a7-4f3d-ab38-1cbfffdef8bd tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: 6e9ef870-363e-4886-9445-96ce8444b819] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:24.059438 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=4 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:05:24.066396 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-869428da-f5a7-4f3d-ab38-1cbfffdef8bd tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:24.067037 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-869428da-f5a7-4f3d-ab38-1cbfffdef8bd tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:24.067844 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-869428da-f5a7-4f3d-ab38-1cbfffdef8bd tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:24.068395 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-869428da-f5a7-4f3d-ab38-1cbfffdef8bd tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:24.094599 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-869428da-f5a7-4f3d-ab38-1cbfffdef8bd tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: 6e9ef870-363e-4886-9445-96ce8444b819] Going to try to terminate instance {{(pid=129875) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 09:05:24.648298 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-869428da-f5a7-4f3d-ab38-1cbfffdef8bd tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819" status: 204 len: 0 microversion: 2.1 time: 0.595304 Jun 17 09:05:24.648893 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 611/1225] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 09:05:24 2022] DELETE /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 09:05:24.658563 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a4830c06-0227-49db-99ec-b282f37a2e94 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:24.659161 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a4830c06-0227-49db-99ec-b282f37a2e94 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: 6e9ef870-363e-4886-9445-96ce8444b819] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:24.666057 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a4830c06-0227-49db-99ec-b282f37a2e94 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:24.666507 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a4830c06-0227-49db-99ec-b282f37a2e94 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:24.667266 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a4830c06-0227-49db-99ec-b282f37a2e94 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:24.667725 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a4830c06-0227-49db-99ec-b282f37a2e94 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:24.801508 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a4830c06-0227-49db-99ec-b282f37a2e94 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:24.809215 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a4830c06-0227-49db-99ec-b282f37a2e94 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819" status: 200 len: 1503 microversion: 2.1 time: 0.155890 Jun 17 09:05:24.815114 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 615/1226] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:24 2022] GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:25.826603 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-83776424-f061-4975-93f0-b0e2661f0764 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:25.827290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-83776424-f061-4975-93f0-b0e2661f0764 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: 6e9ef870-363e-4886-9445-96ce8444b819] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:25.833731 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-83776424-f061-4975-93f0-b0e2661f0764 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:25.834175 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-83776424-f061-4975-93f0-b0e2661f0764 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:25.834928 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-83776424-f061-4975-93f0-b0e2661f0764 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:25.835371 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-83776424-f061-4975-93f0-b0e2661f0764 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:25.963166 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-83776424-f061-4975-93f0-b0e2661f0764 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:25.971156 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-83776424-f061-4975-93f0-b0e2661f0764 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819" status: 200 len: 1503 microversion: 2.1 time: 0.148778 Jun 17 09:05:25.973222 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 612/1227] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:25 2022] GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:26.563880 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-60b074eb-a128-4a9f-bcf4-8366e2819f5f req-45a8176c-d55d-484c-a59f-236f4633e427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e9ef870-363e-4886-9445-96ce8444b819", "name": "network-vif-deleted", "tag": "a6aee089-810c-4274-a9c4-5174509375b2"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:05:26.572511 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-60b074eb-a128-4a9f-bcf4-8366e2819f5f req-45a8176c-d55d-484c-a59f-236f4633e427 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:26.572963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-60b074eb-a128-4a9f-bcf4-8366e2819f5f req-45a8176c-d55d-484c-a59f-236f4633e427 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:26.584790 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-60b074eb-a128-4a9f-bcf4-8366e2819f5f req-45a8176c-d55d-484c-a59f-236f4633e427 service nova] Creating event network-vif-deleted:a6aee089-810c-4274-a9c4-5174509375b2 for instance 6e9ef870-363e-4886-9445-96ce8444b819 on hv-cinder-79760 Jun 17 09:05:26.589792 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-60b074eb-a128-4a9f-bcf4-8366e2819f5f req-45a8176c-d55d-484c-a59f-236f4633e427 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030577 Jun 17 09:05:26.590375 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 616/1228] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 09:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:05:26.989729 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-0359528b-ee6d-4a00-9e68-6376438126be tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:26.990369 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-0359528b-ee6d-4a00-9e68-6376438126be tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: 6e9ef870-363e-4886-9445-96ce8444b819] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:26.996796 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0359528b-ee6d-4a00-9e68-6376438126be tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:27.004572 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0359528b-ee6d-4a00-9e68-6376438126be tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:27.004572 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0359528b-ee6d-4a00-9e68-6376438126be tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:27.004572 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0359528b-ee6d-4a00-9e68-6376438126be tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:27.030352 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0359528b-ee6d-4a00-9e68-6376438126be tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:27.030809 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-0359528b-ee6d-4a00-9e68-6376438126be tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:27.031269 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.objects.instance [None req-0359528b-ee6d-4a00-9e68-6376438126be tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lazy-loading 'fault' on Instance uuid 6e9ef870-363e-4886-9445-96ce8444b819 {{(pid=129875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 09:05:27.079217 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-0359528b-ee6d-4a00-9e68-6376438126be tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:27.080701 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:05:27.085276 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-0359528b-ee6d-4a00-9e68-6376438126be tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819" status: 200 len: 1303 microversion: 2.1 time: 0.099331 Jun 17 09:05:27.085853 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 613/1229] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:26 2022] GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:28.103238 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-5663db43-10f8-4d53-9afa-6b66f6617498 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:28.103992 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-5663db43-10f8-4d53-9afa-6b66f6617498 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: 6e9ef870-363e-4886-9445-96ce8444b819] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:28.110430 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5663db43-10f8-4d53-9afa-6b66f6617498 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:28.110877 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5663db43-10f8-4d53-9afa-6b66f6617498 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:28.111670 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5663db43-10f8-4d53-9afa-6b66f6617498 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:28.112141 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-5663db43-10f8-4d53-9afa-6b66f6617498 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:28.126944 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.wsgi [None req-5663db43-10f8-4d53-9afa-6b66f6617498 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] HTTP exception thrown: Instance 6e9ef870-363e-4886-9445-96ce8444b819 could not be found. Jun 17 09:05:28.128633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-5663db43-10f8-4d53-9afa-6b66f6617498 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Request method failure captured: Jun 17 09:05:28.128633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: request: GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819 HTTP/1.1 Jun 17 09:05:28.128633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept: application/json Jun 17 09:05:28.128633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Accept-Encoding: identity Jun 17 09:05:28.128633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Connection: close Jun 17 09:05:28.128633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Length: 0 Jun 17 09:05:28.128633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Content-Type: application/json Jun 17 09:05:28.128633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Host: 10.222.0.78 Jun 17 09:05:28.128633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: Openstack-System-Scope: None Jun 17 09:05:28.128633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: User-Agent: python-urllib3/1.26.9 Jun 17 09:05:28.128633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Auth-Token: gAAAAABirEPEn_LL1udPTATAO6RAcR8x4eAI9CEbJwGxjziuIAD-sGK6NkVgrOSDoqYkg7pPzb3hoaHpBfcpcd5uWwXQiuicQ8h5f-0_8WT-5Cq9_SyAoLt45Yd2mMwCCn4TDe53WgVU8qGE6e0mh5zx_XDfmZzLDwy17tD6rtB8ueqZVLPwa-g Jun 17 09:05:28.128633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Id: None Jun 17 09:05:28.128633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Domain-Name: None Jun 17 09:05:28.128633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Identity-Status: Confirmed Jun 17 09:05:28.128633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Is-Admin-Project: True Jun 17 09:05:28.128633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Id: default Jun 17 09:05:28.128633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Domain-Name: Default Jun 17 09:05:28.128633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Id: a3661c95e2114a67b40bff418d2f0a3f Jun 17 09:05:28.128633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Project-Name: tempest-VolumesActionsTest-875258510 Jun 17 09:05:28.128633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Role: member,reader Jun 17 09:05:28.128633 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Roles: member,reader Jun 17 09:05:28.130651 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a3661c95e2114a67b40bff418d2f0a3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a3661c95e2114a67b40bff418d2f0a3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a3661c95e2114a67b40bff418d2f0a3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a3661c95e2114a67b40bff418d2f0a3f"}]}] Jun 17 09:05:28.130651 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant: tempest-VolumesActionsTest-875258510 Jun 17 09:05:28.130651 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Id: a3661c95e2114a67b40bff418d2f0a3f Jun 17 09:05:28.130651 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-Tenant-Name: tempest-VolumesActionsTest-875258510 Jun 17 09:05:28.130651 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User: tempest-VolumesActionsTest-875258510-project Jun 17 09:05:28.130651 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Id: default Jun 17 09:05:28.130651 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Domain-Name: Default Jun 17 09:05:28.130651 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Id: efd3c64044394c619a37764e64dff4a2 Jun 17 09:05:28.130651 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: X-User-Name: tempest-VolumesActionsTest-875258510-project Jun 17 09:05:28.130651 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: method: > Jun 17 09:05:28.130651 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: exception: Instance 6e9ef870-363e-4886-9445-96ce8444b819 could not be found. Jun 17 09:05:28.130651 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: action_args: {'id': '6e9ef870-363e-4886-9445-96ce8444b819'} Jun 17 09:05:28.131963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 09:05:28.131963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:05:28.131963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 09:05:28.131963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 09:05:28.131963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 09:05:28.131963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 09:05:28.131963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 09:05:28.131963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 09:05:28.131963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 09:05:28.131963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 09:05:28.131963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e9ef870-363e-4886-9445-96ce8444b819 could not be found. Jun 17 09:05:28.131963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:05:28.131963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:05:28.131963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:05:28.131963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:05:28.131963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:05:28.131963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:05:28.131963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 09:05:28.131963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 09:05:28.131963 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 09:05:28.134547 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 09:05:28.134547 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 09:05:28.134547 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 09:05:28.134547 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 09:05:28.134547 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 09:05:28.134547 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 09:05:28.134547 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 09:05:28.134547 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e9ef870-363e-4886-9445-96ce8444b819 could not be found. Jun 17 09:05:28.134547 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:05:28.134547 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:05:28.134547 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:05:28.134547 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:05:28.134547 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:05:28.134547 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:05:28.134547 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 09:05:28.134547 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 09:05:28.134547 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e9ef870-363e-4886-9445-96ce8444b819 could not be found. Jun 17 09:05:28.134547 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: ERROR nova.api.openstack.wsgi Jun 17 09:05:28.137270 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-5663db43-10f8-4d53-9afa-6b66f6617498 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Returning 404 to user: Instance 6e9ef870-363e-4886-9445-96ce8444b819 could not be found. {{(pid=129876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 09:05:28.137270 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-5663db43-10f8-4d53-9afa-6b66f6617498 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819" status: 404 len: 111 microversion: 2.1 time: 0.031640 Jun 17 09:05:28.137270 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 617/1230] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:28 2022] GET /compute/v2.1/servers/6e9ef870-363e-4886-9445-96ce8444b819 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 09:05:28.227301 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-307b2edd-245b-4d1e-a91e-7c853a4e79a5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1098617017", "imageRef": "978084c7-ed2c-4e42-ac8b-f5d19c4001fe", "flavorRef": "452", "networks": [{"uuid": "18ce522e-401c-4f75-aa04-b101cb609c9f"}]}} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:05:28.285847 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.network.neutron [None req-307b2edd-245b-4d1e-a91e-7c853a4e79a5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] validate_networks() for [('18ce522e-401c-4f75-aa04-b101cb609c9f', None, None, None, None, None)] {{(pid=129875) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 09:05:28.629569 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-307b2edd-245b-4d1e-a91e-7c853a4e79a5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Flavor limits 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 09:05:28.630023 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-307b2edd-245b-4d1e-a91e-7c853a4e79a5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Image limits 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 09:05:28.630524 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-307b2edd-245b-4d1e-a91e-7c853a4e79a5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Flavor pref 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 09:05:28.630930 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-307b2edd-245b-4d1e-a91e-7c853a4e79a5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Image pref 0:0:0 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 09:05:28.631334 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.virt.hardware [None req-307b2edd-245b-4d1e-a91e-7c853a4e79a5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 09:05:28.640292 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-307b2edd-245b-4d1e-a91e-7c853a4e79a5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:28.640796 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-307b2edd-245b-4d1e-a91e-7c853a4e79a5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:28.641558 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-307b2edd-245b-4d1e-a91e-7c853a4e79a5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:28.642018 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-307b2edd-245b-4d1e-a91e-7c853a4e79a5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:28.658559 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-307b2edd-245b-4d1e-a91e-7c853a4e79a5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Getting quotas for project a3661c95e2114a67b40bff418d2f0a3f. Resources: {'ram', 'cores', 'instances'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 09:05:28.662510 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.quota [None req-307b2edd-245b-4d1e-a91e-7c853a4e79a5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Getting quotas for user efd3c64044394c619a37764e64dff4a2 and project a3661c95e2114a67b40bff418d2f0a3f. Resources: {'ram', 'cores', 'instances'} {{(pid=129875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 09:05:28.673855 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-307b2edd-245b-4d1e-a91e-7c853a4e79a5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Going to run 1 instances... {{(pid=129875) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 09:05:28.676108 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-307b2edd-245b-4d1e-a91e-7c853a4e79a5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: bfb7509e-9dd0-44da-8011-915b825d79b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='978084c7-ed2c-4e42-ac8b-f5d19c4001fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 09:05:28.801741 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-307b2edd-245b-4d1e-a91e-7c853a4e79a5 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578183 Jun 17 09:05:28.802823 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 614/1231] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jun 17 09:05:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 09:05:28.813300 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-8eebf9c2-ebd3-4055-aa75-61e287edd06a tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:28.813942 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-8eebf9c2-ebd3-4055-aa75-61e287edd06a tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: bfb7509e-9dd0-44da-8011-915b825d79b8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:28.868325 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-8eebf9c2-ebd3-4055-aa75-61e287edd06a tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:28.875266 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-8eebf9c2-ebd3-4055-aa75-61e287edd06a tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8" status: 200 len: 1214 microversion: 2.1 time: 0.065873 Jun 17 09:05:28.875861 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 618/1232] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:28 2022] GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 09:05:29.892845 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-100855fc-40d3-40e2-b328-bf0c22bcc556 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:29.893510 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-100855fc-40d3-40e2-b328-bf0c22bcc556 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: bfb7509e-9dd0-44da-8011-915b825d79b8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:29.895290 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:05:29.903148 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-100855fc-40d3-40e2-b328-bf0c22bcc556 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:29.903148 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-100855fc-40d3-40e2-b328-bf0c22bcc556 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:29.903148 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-100855fc-40d3-40e2-b328-bf0c22bcc556 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:29.903148 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-100855fc-40d3-40e2-b328-bf0c22bcc556 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:29.963170 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-100855fc-40d3-40e2-b328-bf0c22bcc556 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:29.970957 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-100855fc-40d3-40e2-b328-bf0c22bcc556 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8" status: 200 len: 1218 microversion: 2.1 time: 0.082565 Jun 17 09:05:29.971701 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 615/1233] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:29 2022] GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:30.988021 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-2b070dbf-9bce-457b-9067-9605a7611e52 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:30.988713 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-2b070dbf-9bce-457b-9067-9605a7611e52 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: bfb7509e-9dd0-44da-8011-915b825d79b8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:30.991141 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:05:31.001074 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2b070dbf-9bce-457b-9067-9605a7611e52 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:31.007302 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2b070dbf-9bce-457b-9067-9605a7611e52 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:31.007302 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2b070dbf-9bce-457b-9067-9605a7611e52 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:31.007302 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-2b070dbf-9bce-457b-9067-9605a7611e52 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:31.072917 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-2b070dbf-9bce-457b-9067-9605a7611e52 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:31.081093 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-2b070dbf-9bce-457b-9067-9605a7611e52 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8" status: 200 len: 1274 microversion: 2.1 time: 0.096935 Jun 17 09:05:31.081665 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 619/1234] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:30 2022] GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8 => generated 1274 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:32.098439 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-3f50386a-a6f8-4894-9a75-fece02a15a55 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:32.099165 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-3f50386a-a6f8-4894-9a75-fece02a15a55 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: bfb7509e-9dd0-44da-8011-915b825d79b8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:32.106316 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3f50386a-a6f8-4894-9a75-fece02a15a55 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:32.106850 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3f50386a-a6f8-4894-9a75-fece02a15a55 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:32.108188 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3f50386a-a6f8-4894-9a75-fece02a15a55 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:32.116799 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-3f50386a-a6f8-4894-9a75-fece02a15a55 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:32.243906 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-3f50386a-a6f8-4894-9a75-fece02a15a55 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:32.252079 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-3f50386a-a6f8-4894-9a75-fece02a15a55 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8" status: 200 len: 1314 microversion: 2.1 time: 0.157969 Jun 17 09:05:32.252643 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 616/1235] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:32 2022] GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:32.754350 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [req-ce420517-2d71-49c0-89c6-fa168da899b7 req-383b2afe-1afe-4f30-a754-52ed26111f91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfb7509e-9dd0-44da-8011-915b825d79b8", "tag": "90afbf5f-739c-4ecd-88b8-3a6623da7f16"}]} {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:05:32.764672 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-ce420517-2d71-49c0-89c6-fa168da899b7 req-383b2afe-1afe-4f30-a754-52ed26111f91 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:32.765118 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [req-ce420517-2d71-49c0-89c6-fa168da899b7 req-383b2afe-1afe-4f30-a754-52ed26111f91 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:32.767729 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:05:32.780298 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.compute.server_external_events [req-ce420517-2d71-49c0-89c6-fa168da899b7 req-383b2afe-1afe-4f30-a754-52ed26111f91 service nova] Creating event network-changed:90afbf5f-739c-4ecd-88b8-3a6623da7f16 for instance bfb7509e-9dd0-44da-8011-915b825d79b8 on hv-cinder-79760 Jun 17 09:05:32.783697 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [req-ce420517-2d71-49c0-89c6-fa168da899b7 req-383b2afe-1afe-4f30-a754-52ed26111f91 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033607 Jun 17 09:05:32.784292 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 620/1236] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 09:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:05:33.270356 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-163ff5ee-68ca-47d1-9f11-10f1a36ddc3f tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:33.270989 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-163ff5ee-68ca-47d1-9f11-10f1a36ddc3f tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: bfb7509e-9dd0-44da-8011-915b825d79b8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:33.277792 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-163ff5ee-68ca-47d1-9f11-10f1a36ddc3f tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:33.278356 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-163ff5ee-68ca-47d1-9f11-10f1a36ddc3f tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:33.279118 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-163ff5ee-68ca-47d1-9f11-10f1a36ddc3f tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:33.279586 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-163ff5ee-68ca-47d1-9f11-10f1a36ddc3f tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:33.408579 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-163ff5ee-68ca-47d1-9f11-10f1a36ddc3f tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:33.416341 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-163ff5ee-68ca-47d1-9f11-10f1a36ddc3f tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8" status: 200 len: 1314 microversion: 2.1 time: 0.150079 Jun 17 09:05:33.416921 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 617/1237] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:33 2022] GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:34.434827 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-0bd05a05-965d-4206-823c-a8bc5e10c6b3 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:34.435551 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-0bd05a05-965d-4206-823c-a8bc5e10c6b3 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: bfb7509e-9dd0-44da-8011-915b825d79b8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:34.443119 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0bd05a05-965d-4206-823c-a8bc5e10c6b3 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:34.443586 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0bd05a05-965d-4206-823c-a8bc5e10c6b3 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:34.444347 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0bd05a05-965d-4206-823c-a8bc5e10c6b3 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:34.444782 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-0bd05a05-965d-4206-823c-a8bc5e10c6b3 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:34.577209 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-0bd05a05-965d-4206-823c-a8bc5e10c6b3 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:34.584556 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-0bd05a05-965d-4206-823c-a8bc5e10c6b3 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8" status: 200 len: 1314 microversion: 2.1 time: 0.154710 Jun 17 09:05:34.585117 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 621/1238] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:34 2022] GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:35.602022 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-f5be367e-82e8-4a5f-862b-d583c7e41a6e tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:35.602590 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-f5be367e-82e8-4a5f-862b-d583c7e41a6e tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: bfb7509e-9dd0-44da-8011-915b825d79b8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:35.609567 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f5be367e-82e8-4a5f-862b-d583c7e41a6e tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:35.610011 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f5be367e-82e8-4a5f-862b-d583c7e41a6e tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:35.610762 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f5be367e-82e8-4a5f-862b-d583c7e41a6e tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:35.611196 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-f5be367e-82e8-4a5f-862b-d583c7e41a6e tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:35.743370 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-f5be367e-82e8-4a5f-862b-d583c7e41a6e tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:35.751622 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-f5be367e-82e8-4a5f-862b-d583c7e41a6e tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8" status: 200 len: 1314 microversion: 2.1 time: 0.153504 Jun 17 09:05:35.752188 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 618/1239] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:35 2022] GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:36.768521 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-d5107a9b-c3d1-4987-bc0f-769d02e41c90 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:36.769145 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-d5107a9b-c3d1-4987-bc0f-769d02e41c90 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: bfb7509e-9dd0-44da-8011-915b825d79b8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:36.775897 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d5107a9b-c3d1-4987-bc0f-769d02e41c90 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:36.776353 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d5107a9b-c3d1-4987-bc0f-769d02e41c90 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:36.777162 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d5107a9b-c3d1-4987-bc0f-769d02e41c90 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:36.777600 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-d5107a9b-c3d1-4987-bc0f-769d02e41c90 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:36.912466 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-d5107a9b-c3d1-4987-bc0f-769d02e41c90 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:36.914133 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-d5107a9b-c3d1-4987-bc0f-769d02e41c90 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8" status: 200 len: 1314 microversion: 2.1 time: 0.149575 Jun 17 09:05:36.914699 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 622/1240] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:36 2022] GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:37.190765 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-5d7c5362-8678-4de2-92cd-d82bab41baab req-daba694e-234a-4f9a-9cb2-c0a4fe07a3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfb7509e-9dd0-44da-8011-915b825d79b8", "name": "network-vif-plugged", "status": "completed", "tag": "90afbf5f-739c-4ecd-88b8-3a6623da7f16"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:05:37.199134 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-5d7c5362-8678-4de2-92cd-d82bab41baab req-daba694e-234a-4f9a-9cb2-c0a4fe07a3b8 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:37.199836 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-5d7c5362-8678-4de2-92cd-d82bab41baab req-daba694e-234a-4f9a-9cb2-c0a4fe07a3b8 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:37.211340 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-5d7c5362-8678-4de2-92cd-d82bab41baab req-daba694e-234a-4f9a-9cb2-c0a4fe07a3b8 service nova] Creating event network-vif-plugged:90afbf5f-739c-4ecd-88b8-3a6623da7f16 for instance bfb7509e-9dd0-44da-8011-915b825d79b8 on hv-cinder-79760 Jun 17 09:05:37.217234 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-5d7c5362-8678-4de2-92cd-d82bab41baab req-daba694e-234a-4f9a-9cb2-c0a4fe07a3b8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029607 Jun 17 09:05:37.217978 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 619/1241] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 09:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 09:05:37.932265 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-c6adf999-d613-461d-9639-32b5006eb28a tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:37.932826 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-c6adf999-d613-461d-9639-32b5006eb28a tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: bfb7509e-9dd0-44da-8011-915b825d79b8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:37.940046 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c6adf999-d613-461d-9639-32b5006eb28a tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:37.940490 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c6adf999-d613-461d-9639-32b5006eb28a tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:37.941240 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c6adf999-d613-461d-9639-32b5006eb28a tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:37.941670 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-c6adf999-d613-461d-9639-32b5006eb28a tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:38.072685 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-c6adf999-d613-461d-9639-32b5006eb28a tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:38.080826 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-c6adf999-d613-461d-9639-32b5006eb28a tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8" status: 200 len: 1314 microversion: 2.1 time: 0.152562 Jun 17 09:05:38.081396 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 623/1242] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:37 2022] GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:39.098594 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-659886c9-c676-4f34-b842-a43317598d02 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:39.099297 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-659886c9-c676-4f34-b842-a43317598d02 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: bfb7509e-9dd0-44da-8011-915b825d79b8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:39.101709 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=2 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:05:39.102365 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG dbcounter [-] [129875] Writing DB stats nova_cell0:SELECT=6 {{(pid=129875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:05:39.108255 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-659886c9-c676-4f34-b842-a43317598d02 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:39.108839 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-659886c9-c676-4f34-b842-a43317598d02 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:39.109614 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-659886c9-c676-4f34-b842-a43317598d02 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:39.110057 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-659886c9-c676-4f34-b842-a43317598d02 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:39.241745 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-659886c9-c676-4f34-b842-a43317598d02 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:39.249189 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-659886c9-c676-4f34-b842-a43317598d02 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8" status: 200 len: 1497 microversion: 2.1 time: 0.155054 Jun 17 09:05:39.249767 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 620/1243] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:39 2022] GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8 => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:40.096756 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-8ba55e07-f6a8-478c-8090-7787a9007f60 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:40.107740 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-8ba55e07-f6a8-478c-8090-7787a9007f60 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: bfb7509e-9dd0-44da-8011-915b825d79b8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:40.107740 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG dbcounter [-] [129876] Writing DB stats nova_cell0:SELECT=2 {{(pid=129876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:05:40.107740 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8ba55e07-f6a8-478c-8090-7787a9007f60 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:40.107740 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8ba55e07-f6a8-478c-8090-7787a9007f60 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:40.107740 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8ba55e07-f6a8-478c-8090-7787a9007f60 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:40.108343 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-8ba55e07-f6a8-478c-8090-7787a9007f60 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:40.134709 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-8ba55e07-f6a8-478c-8090-7787a9007f60 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: bfb7509e-9dd0-44da-8011-915b825d79b8] Going to try to terminate instance {{(pid=129876) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 09:05:40.496869 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-8ba55e07-f6a8-478c-8090-7787a9007f60 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8" status: 204 len: 0 microversion: 2.1 time: 0.404220 Jun 17 09:05:40.497462 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 624/1244] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jun 17 09:05:40 2022] DELETE /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 09:05:40.505739 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-7822cb6f-83ef-4fe2-99a2-5b35774c58b7 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:40.511561 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-7822cb6f-83ef-4fe2-99a2-5b35774c58b7 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: bfb7509e-9dd0-44da-8011-915b825d79b8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:40.513163 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7822cb6f-83ef-4fe2-99a2-5b35774c58b7 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:40.513607 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7822cb6f-83ef-4fe2-99a2-5b35774c58b7 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:40.514367 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7822cb6f-83ef-4fe2-99a2-5b35774c58b7 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:40.514791 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-7822cb6f-83ef-4fe2-99a2-5b35774c58b7 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:40.644726 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.policy [None req-7822cb6f-83ef-4fe2-99a2-5b35774c58b7 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129875) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:40.652131 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-7822cb6f-83ef-4fe2-99a2-5b35774c58b7 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8" status: 200 len: 1503 microversion: 2.1 time: 0.150293 Jun 17 09:05:40.652705 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 621/1245] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:40 2022] GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:41.671255 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-a48b3e01-066e-4619-8bcf-fbe7f208bd04 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:41.671892 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-a48b3e01-066e-4619-8bcf-fbe7f208bd04 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: bfb7509e-9dd0-44da-8011-915b825d79b8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:41.679620 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a48b3e01-066e-4619-8bcf-fbe7f208bd04 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:41.680043 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a48b3e01-066e-4619-8bcf-fbe7f208bd04 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:41.680821 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a48b3e01-066e-4619-8bcf-fbe7f208bd04 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:41.681251 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-a48b3e01-066e-4619-8bcf-fbe7f208bd04 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:41.813514 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-a48b3e01-066e-4619-8bcf-fbe7f208bd04 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:41.821447 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-a48b3e01-066e-4619-8bcf-fbe7f208bd04 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8" status: 200 len: 1503 microversion: 2.1 time: 0.155018 Jun 17 09:05:41.822025 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 625/1246] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:41 2022] GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 09:05:42.376003 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [req-d4f33ccb-5317-4f2d-91c7-b6c7ccff68c7 req-aaa01a4e-008f-477e-a72d-32251eb73bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfb7509e-9dd0-44da-8011-915b825d79b8", "name": "network-vif-deleted", "tag": "90afbf5f-739c-4ecd-88b8-3a6623da7f16"}]} {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 09:05:42.384311 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-d4f33ccb-5317-4f2d-91c7-b6c7ccff68c7 req-aaa01a4e-008f-477e-a72d-32251eb73bd8 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:42.385597 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [req-d4f33ccb-5317-4f2d-91c7-b6c7ccff68c7 req-aaa01a4e-008f-477e-a72d-32251eb73bd8 service nova] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:42.396155 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.compute.server_external_events [req-d4f33ccb-5317-4f2d-91c7-b6c7ccff68c7 req-aaa01a4e-008f-477e-a72d-32251eb73bd8 service nova] Creating event network-vif-deleted:90afbf5f-739c-4ecd-88b8-3a6623da7f16 for instance bfb7509e-9dd0-44da-8011-915b825d79b8 on hv-cinder-79760 Jun 17 09:05:42.400911 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [req-d4f33ccb-5317-4f2d-91c7-b6c7ccff68c7 req-aaa01a4e-008f-477e-a72d-32251eb73bd8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028797 Jun 17 09:05:42.401482 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 622/1247] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jun 17 09:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 09:05:42.838542 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.api.openstack.wsgi [None req-513b82ed-473c-446f-8066-eba358a3229b tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:42.839179 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.compute.api [None req-513b82ed-473c-446f-8066-eba358a3229b tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: bfb7509e-9dd0-44da-8011-915b825d79b8] Fetching instance by UUID {{(pid=129876) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:42.845805 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-513b82ed-473c-446f-8066-eba358a3229b tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:42.846257 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-513b82ed-473c-446f-8066-eba358a3229b tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:42.847023 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-513b82ed-473c-446f-8066-eba358a3229b tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:42.847487 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-513b82ed-473c-446f-8066-eba358a3229b tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:42.879125 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-513b82ed-473c-446f-8066-eba358a3229b tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:42.879613 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG oslo_concurrency.lockutils [None req-513b82ed-473c-446f-8066-eba358a3229b tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:42.880065 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.objects.instance [None req-513b82ed-473c-446f-8066-eba358a3229b tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lazy-loading 'fault' on Instance uuid bfb7509e-9dd0-44da-8011-915b825d79b8 {{(pid=129876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 09:05:42.925064 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: DEBUG nova.policy [None req-513b82ed-473c-446f-8066-eba358a3229b tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd3c64044394c619a37764e64dff4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3661c95e2114a67b40bff418d2f0a3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129876) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 09:05:42.929373 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: INFO nova.api.openstack.requestlog [None req-513b82ed-473c-446f-8066-eba358a3229b tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8" status: 200 len: 1304 microversion: 2.1 time: 0.094732 Jun 17 09:05:42.929918 dv-cinder-797608-33-iscsi devstack@n-api.service[129876]: [pid: 129876|app: 0|req: 626/1248] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:42 2022] GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 09:05:43.948369 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-50f1c0c3-ae34-42a3-9f67-c82880f90ed2 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Calling method '>' {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 09:05:43.949054 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.compute.api [None req-50f1c0c3-ae34-42a3-9f67-c82880f90ed2 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] [instance: bfb7509e-9dd0-44da-8011-915b825d79b8] Fetching instance by UUID {{(pid=129875) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 09:05:43.955833 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-50f1c0c3-ae34-42a3-9f67-c82880f90ed2 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:43.956275 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-50f1c0c3-ae34-42a3-9f67-c82880f90ed2 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:43.957022 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-50f1c0c3-ae34-42a3-9f67-c82880f90ed2 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 09:05:43.957450 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG oslo_concurrency.lockutils [None req-50f1c0c3-ae34-42a3-9f67-c82880f90ed2 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Lock "4ac623a5-dc81-4845-8d0c-a315180756a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 09:05:43.971403 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.wsgi [None req-50f1c0c3-ae34-42a3-9f67-c82880f90ed2 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] HTTP exception thrown: Instance bfb7509e-9dd0-44da-8011-915b825d79b8 could not be found. Jun 17 09:05:43.973010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-50f1c0c3-ae34-42a3-9f67-c82880f90ed2 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Request method failure captured: Jun 17 09:05:43.973010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: request: GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8 HTTP/1.1 Jun 17 09:05:43.973010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept: application/json Jun 17 09:05:43.973010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Accept-Encoding: identity Jun 17 09:05:43.973010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Connection: close Jun 17 09:05:43.973010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Length: 0 Jun 17 09:05:43.973010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Content-Type: application/json Jun 17 09:05:43.973010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Host: 10.222.0.78 Jun 17 09:05:43.973010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: Openstack-System-Scope: None Jun 17 09:05:43.973010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: User-Agent: python-urllib3/1.26.9 Jun 17 09:05:43.973010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Auth-Token: gAAAAABirEPEn_LL1udPTATAO6RAcR8x4eAI9CEbJwGxjziuIAD-sGK6NkVgrOSDoqYkg7pPzb3hoaHpBfcpcd5uWwXQiuicQ8h5f-0_8WT-5Cq9_SyAoLt45Yd2mMwCCn4TDe53WgVU8qGE6e0mh5zx_XDfmZzLDwy17tD6rtB8ueqZVLPwa-g Jun 17 09:05:43.973010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Id: None Jun 17 09:05:43.973010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Domain-Name: None Jun 17 09:05:43.973010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Identity-Status: Confirmed Jun 17 09:05:43.973010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Is-Admin-Project: True Jun 17 09:05:43.973010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Id: default Jun 17 09:05:43.973010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Domain-Name: Default Jun 17 09:05:43.973010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Id: a3661c95e2114a67b40bff418d2f0a3f Jun 17 09:05:43.973010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Project-Name: tempest-VolumesActionsTest-875258510 Jun 17 09:05:43.973010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Role: member,reader Jun 17 09:05:43.973010 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Roles: member,reader Jun 17 09:05:43.974708 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a3661c95e2114a67b40bff418d2f0a3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a3661c95e2114a67b40bff418d2f0a3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a3661c95e2114a67b40bff418d2f0a3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a3661c95e2114a67b40bff418d2f0a3f"}]}] Jun 17 09:05:43.974708 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant: tempest-VolumesActionsTest-875258510 Jun 17 09:05:43.974708 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Id: a3661c95e2114a67b40bff418d2f0a3f Jun 17 09:05:43.974708 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-Tenant-Name: tempest-VolumesActionsTest-875258510 Jun 17 09:05:43.974708 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User: tempest-VolumesActionsTest-875258510-project Jun 17 09:05:43.974708 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Id: default Jun 17 09:05:43.974708 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Domain-Name: Default Jun 17 09:05:43.974708 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Id: efd3c64044394c619a37764e64dff4a2 Jun 17 09:05:43.974708 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: X-User-Name: tempest-VolumesActionsTest-875258510-project Jun 17 09:05:43.974708 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: method: > Jun 17 09:05:43.974708 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: exception: Instance bfb7509e-9dd0-44da-8011-915b825d79b8 could not be found. Jun 17 09:05:43.974708 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: action_args: {'id': 'bfb7509e-9dd0-44da-8011-915b825d79b8'} Jun 17 09:05:43.975756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: {{(pid=129875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 09:05:43.975756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:05:43.975756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 09:05:43.975756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 09:05:43.975756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 09:05:43.975756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 09:05:43.975756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 09:05:43.975756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 09:05:43.975756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 09:05:43.975756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 09:05:43.975756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfb7509e-9dd0-44da-8011-915b825d79b8 could not be found. Jun 17 09:05:43.975756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:05:43.975756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:05:43.975756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:05:43.975756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:05:43.975756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:05:43.975756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:05:43.975756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 09:05:43.975756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 09:05:43.975756 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 09:05:43.977402 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 09:05:43.977402 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 09:05:43.977402 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 09:05:43.977402 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 09:05:43.977402 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 09:05:43.977402 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 09:05:43.977402 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 09:05:43.977402 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfb7509e-9dd0-44da-8011-915b825d79b8 could not be found. Jun 17 09:05:43.977402 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:05:43.977402 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 09:05:43.977402 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:05:43.977402 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 09:05:43.977402 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 09:05:43.977402 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 09:05:43.977402 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 09:05:43.977402 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 09:05:43.977402 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfb7509e-9dd0-44da-8011-915b825d79b8 could not be found. Jun 17 09:05:43.977402 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: ERROR nova.api.openstack.wsgi Jun 17 09:05:43.978812 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: DEBUG nova.api.openstack.wsgi [None req-50f1c0c3-ae34-42a3-9f67-c82880f90ed2 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] Returning 404 to user: Instance bfb7509e-9dd0-44da-8011-915b825d79b8 could not be found. {{(pid=129875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 09:05:43.978812 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: INFO nova.api.openstack.requestlog [None req-50f1c0c3-ae34-42a3-9f67-c82880f90ed2 tempest-VolumesActionsTest-875258510 tempest-VolumesActionsTest-875258510-project] 10.222.0.78 "GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8" status: 404 len: 111 microversion: 2.1 time: 0.030756 Jun 17 09:05:43.978812 dv-cinder-797608-33-iscsi devstack@n-api.service[129875]: [pid: 129875|app: 0|req: 623/1249] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jun 17 09:05:43 2022] GET /compute/v2.1/servers/bfb7509e-9dd0-44da-8011-915b825d79b8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)